Periodic parameter estimation for visual-inertial tracking systems

    公开(公告)号:US12210672B2

    公开(公告)日:2025-01-28

    申请号:US18116511

    申请日:2023-03-02

    Applicant: Snap Inc.

    Abstract: A method for calibrating a visual-inertial tracking system is described. A device operates the visual-inertial tracking system without receiving a tracking request from a virtual object display application. In response to operating the visual-inertial tracking system, the device accesses sensor data from sensors at the device. The device identifies, based on the sensor data, a first calibration parameter value of the visual-inertial tracking system and stores the first calibration parameter value. The system detects a tracking request from the virtual object display application. In response to the tracking request, the system accesses the first calibration parameter value and determines a second calibration parameter value from the first calibration parameter value.

    Direct scale level selection for multilevel feature tracking under motion blur

    公开(公告)号:US12192625B2

    公开(公告)日:2025-01-07

    申请号:US18321565

    申请日:2023-05-22

    Applicant: Snap Inc.

    Abstract: A method for mitigating motion blur in a visual-inertial tracking system is described. In one aspect, the method includes accessing a first image generated by an optical sensor of the visual tracking system, accessing a second image generated by the optical sensor of the visual tracking system, the second image following the first image, determining a first motion blur level of the first image, determining a second motion blur level of the second image, identifying a scale change between the first image and the second image, determining a first optimal scale level for the first image based on the first motion blur level and the scale change, and determining a second optimal scale level for the second image based on the second motion blur level and the scale change.

    Visual-inertial tracking using rolling shutter cameras

    公开(公告)号:US12028626B2

    公开(公告)日:2024-07-02

    申请号:US18098939

    申请日:2023-01-19

    Applicant: Snap Inc.

    Abstract: Visual-inertial tracking of an eyewear device using a rolling shutter camera(s). The eyewear device includes a position determining system. Visual-inertial tracking is implemented by sensing motion of the eyewear device. An initial pose is obtained for a rolling shutter camera and an image of an environment is captured. The image includes feature points captured at a particular capture time. A number of poses for the rolling shutter camera is computed based on the initial pose and sensed movement of the device. The number of computed poses is responsive to the sensed movement of the mobile device. A computed pose is selected for each feature point in the image by matching the particular capture time for the feature point to the particular computed time for the computed pose. The position of the mobile device is determined within the environment using the feature points and the selected computed poses for the feature points.

    SELECTIVE IMAGE PYRAMID COMPUTATION FOR MOTION BLUR MITIGATION IN VISUAL-INERTIAL TRACKING

    公开(公告)号:US20220375041A1

    公开(公告)日:2022-11-24

    申请号:US17521081

    申请日:2021-11-08

    Applicant: Snap Inc.

    Abstract: A method for mitigating motion blur in a visual tracking system is described. In one aspect, a method for selective motion blur mitigation in a visual tracking system includes accessing a first image generated by an optical sensor of the visual tracking system, identifying camera operating parameters of the optical sensor during the optical sensor generating the first image, determining a motion of the optical sensor during the optical sensor generating the first image, determining a motion blur level of the first image based on the camera operating parameters of the optical sensor and the motion of the optical sensor, and determining whether to downscale the first image using a pyramid computation algorithm based on the motion blur level.

    PERIODIC PARAMETER ESTIMATION FOR VISUAL-INERTIAL TRACKING SYSTEMS

    公开(公告)号:US20250093948A1

    公开(公告)日:2025-03-20

    申请号:US18970124

    申请日:2024-12-05

    Applicant: Snap Inc.

    Abstract: A method for calibrating a visual-inertial tracking system is described. A device operates the visual-inertial tracking system without receiving a tracking request from a virtual object display application. In response to operating the visual-inertial tracking system, the device accesses sensor data from sensors at the device. The device identifies, based on the sensor data, a first calibration parameter value of the visual-inertial tracking system and stores the first calibration parameter value. The system detects a tracking request from the virtual object display application. In response to the tracking request, the system accesses the first calibration parameter value and determines a second calibration parameter value from the first calibration parameter value.

    DIRECT SCALE LEVEL SELECTION FOR MULTILEVEL FEATURE TRACKING UNDER MOTION BLUR

    公开(公告)号:US20250071422A1

    公开(公告)日:2025-02-27

    申请号:US18947329

    申请日:2024-11-14

    Applicant: Snap Inc.

    Abstract: A method for mitigating motion blur in a visual-inertial tracking system is described. In one aspect, the method includes accessing a first image generated by an optical sensor of the visual tracking system, accessing a second image generated by the optical sensor of the visual tracking system, the second image following the first image, determining a first motion blur level of the first image, determining a second motion blur level of the second image, identifying a scale change between the first image and the second image, determining a first optimal scale level for the first image based on the first motion blur level and the scale change, and determining a second optimal scale level for the second image based on the second motion blur level and the scale change.

    VISUAL-INERTIAL TRACKING USING ROLLING SHUTTER CAMERAS

    公开(公告)号:US20240314461A1

    公开(公告)日:2024-09-19

    申请号:US18677296

    申请日:2024-05-29

    Applicant: Snap Inc.

    Abstract: Visual-inertial tracking of an eyewear device using a rolling shutter camera(s). The device includes a position determining system. Visual-inertial tracking is implemented by sensing motion of the device. An initial pose is obtained for a rolling shutter camera and an image of an environment is captured. The image includes feature points captured at a particular capture time. A number of poses for the rolling shutter camera is computed based on the initial pose and sensed movement of the device. The number of computed poses is responsive to the sensed movement of the mobile device. A computed pose is selected for each feature point in the image by matching the particular capture time for the feature point to the particular computed time for the computed pose. The position of the mobile device is determined within the environment using the feature points and the selected computed poses for the feature points.

    Dynamic adjustment of exposure and iso to limit motion blur

    公开(公告)号:US11765457B2

    公开(公告)日:2023-09-19

    申请号:US17522642

    申请日:2021-11-09

    Applicant: Snap Inc.

    CPC classification number: H04N23/6811 H04N23/684 H04N23/6812 G06T19/006

    Abstract: A method for limiting motion blur in a visual tracking system is described. In one aspect, the method includes accessing a first image generated by an optical sensor of the visual tracking system, identifying camera operating parameters of the optical sensor for the first image, determining a motion of the optical sensor for the first image, determining a motion blur level of the first image based on the camera operating parameters of the optical sensor and the motion of the optical sensor, and adjusting the camera operating parameters of the optical sensor based on the motion blur level.

    DYNAMIC ADJUSTMENT OF EXPOSURE AND ISO TO LIMIT MOTION BLUR

    公开(公告)号:US20220377239A1

    公开(公告)日:2022-11-24

    申请号:US17522642

    申请日:2021-11-09

    Applicant: Snap Inc.

    Abstract: A method for limiting motion blur in a visual tracking system is described. In one aspect, the method includes accessing a first image generated by an optical sensor of the visual tracking system, identifying camera operating parameters of the optical sensor for the first image, determining a motion of the optical sensor for the first image, determining a motion blur level of the first image based on the camera operating parameters of the optical sensor and the motion of the optical sensor, and adjusting the camera operating parameters of the optical sensor based on the motion blur level.

Patent Agency Ranking