公开(公告)号：US12271517B1

公开(公告)日：2025-04-08

申请号：US18478352

申请日：2023-09-29

Applicant: Snap Inc.

Inventor： Thomas Faeulhammer ,  Matthias Kalkgruber ,  Thomas Muttenthaler ,  Tiago Miguel Pereira Torres ,  Daniel Wolf

IPC: G06F3/01 ,  A61B5/16 ,  G06T17/00

Abstract: Bending data is used to facilitate tracking operations of an extended reality (XR) device, such as hand tracking or other object tracking operations. The XR device obtains bending data indicative of bending of the XR device to accommodate a body part of a user wearing the XR device. The XR device determines, based on the bending data, whether to use previously identified biometric data in a tracking operation. A mode of the XR device is selected responsive to determining whether to use the previously identified biometric data. The selected mode is used to initialize the tracking operation. The selected mode may be a first mode in which the previously identified biometric data is used in the tracking operation or a second mode in which the previously identified biometric data is not used in the tracking operation.

公开(公告)号：US20250054176A1

公开(公告)日：2025-02-13

申请号：US18475720

申请日：2023-09-27

Applicant: Snap Inc.

Inventor： Evangelos Chatzikalymnios ,  Thomas Faeulhammer ,  Ihor Tymchyshyn ,  Daniel Wolf

IPC: G06T7/70 ,  G06T3/40 ,  G06T7/20 ,  G06T7/62 ,  G06V10/25 ,  G06V40/20

Abstract: A device includes a processor, image sensors, and memory storing instructions to obtain images from the sensors and process a first image to identify coordinates of a bounding box around an object. The device processes the area within the first box to determine 2-D positions of landmarks associated with the object, derives first 3-D positions of the landmarks, and determines coordinates of a second box bounding the object in the second image using the 3-D landmark positions. The device processes the area within the second box to determine 2-D positions of landmarks and uses triangulation to derive second 3-D positions of the landmarks. Overall, the device obtains images, detects objects and landmarks, determines 2-D and 3-D positions of landmarks, and triangulates 3-D positions.

公开(公告)号：US20250068228A1

公开(公告)日：2025-02-27

申请号：US18478853

申请日：2023-09-29

Applicant: Snap Inc.

Inventor： Evangelos Chatzikalymnios ,  Thomas Faeulhammer ,  Daniel Wolf ,  Kai Zhou

IPC: G06F1/3287 ,  G06V40/10

Abstract: Examples describe a method performed by an extended reality (XR) device that implements a multi-camera object tracking system. The XR device accesses object tracking data associated with an object in a real-world environment. Based on the object tracking data, the XR device activates a low-power mode of the multi-camera object tracking system. In the low-power mode, a state of the object in the real-world environment is determined by using the multi-camera object tracking system.