REDUCING POWER CONSUMPTION OF EXTENDED REALITY DEVICES

    公开(公告)号:US20250068228A1

    公开(公告)日:2025-02-27

    申请号:US18478853

    申请日:2023-09-29

    Applicant: Snap Inc.

    Abstract: Examples describe a method performed by an extended reality (XR) device that implements a multi-camera object tracking system. The XR device accesses object tracking data associated with an object in a real-world environment. Based on the object tracking data, the XR device activates a low-power mode of the multi-camera object tracking system. In the low-power mode, a state of the object in the real-world environment is determined by using the multi-camera object tracking system.

    SELECTIVE IMAGE PYRAMID COMPUTATION FOR MOTION BLUR MITIGATION IN VISUAL-INERTIAL TRACKING

    公开(公告)号:US20250037249A1

    公开(公告)日:2025-01-30

    申请号:US18915975

    申请日:2024-10-15

    Applicant: Snap Inc.

    Abstract: A method for mitigating motion blur in a visual tracking system is described. In one aspect, a method for selective motion blur mitigation in a visual tracking system includes accessing a first image generated by an optical sensor of the visual tracking system, identifying camera operating parameters of the optical sensor during the optical sensor generating the first image, determining a motion of the optical sensor during the optical sensor generating the first image, determining a motion blur level of the first image based on the camera operating parameters of the optical sensor and the motion of the optical sensor, and determining whether to downscale the first image using a pyramid computation algorithm based on the motion blur level.

    DIRECT SCALE LEVEL SELECTION FOR MULTILEVEL FEATURE TRACKING UNDER MOTION BLUR

    公开(公告)号:US20230300464A1

    公开(公告)日:2023-09-21

    申请号:US18321565

    申请日:2023-05-22

    Applicant: Snap Inc.

    Abstract: A method for mitigating motion blur in a visual-inertial tracking system is described. In one aspect, the method includes accessing a first image generated by an optical sensor of the visual tracking system, accessing a second image generated by the optical sensor of the visual tracking system, the second image following the first image, determining a first motion blur level of the first image, determining a second motion blur level of the second image, identifying a scale change between the first image and the second image, determining a first optimal scale level for the first image based on the first motion blur level and the scale change, and determining a second optimal scale level for the second image based on the second motion blur level and the scale change.

    BOUNDING BOX TRANSFORMATION FOR OBJECT DEPTH ESTIMATION IN A MULTI-CAMERA DEVICE

    公开(公告)号:US20250054176A1

    公开(公告)日:2025-02-13

    申请号:US18475720

    申请日:2023-09-27

    Applicant: Snap Inc.

    Abstract: A device includes a processor, image sensors, and memory storing instructions to obtain images from the sensors and process a first image to identify coordinates of a bounding box around an object. The device processes the area within the first box to determine 2-D positions of landmarks associated with the object, derives first 3-D positions of the landmarks, and determines coordinates of a second box bounding the object in the second image using the 3-D landmark positions. The device processes the area within the second box to determine 2-D positions of landmarks and uses triangulation to derive second 3-D positions of the landmarks. Overall, the device obtains images, detects objects and landmarks, determines 2-D and 3-D positions of landmarks, and triangulates 3-D positions.

Patent Agency Ranking