-
公开(公告)号：WO2022246383A1
公开(公告)日：2022-11-24
申请号：PCT/US2022/072340
申请日：2022-05-16
Applicant: SNAP INC.
Inventor： KALKGRUBER, Matthias , WOLF, Daniel
Abstract: A method for mitigating motion blur in a visual-inertial tracking system is described. In one aspect, the method includes accessing a first image generated by an optical sensor of the visual tracking system, accessing a second image generated by the optical sensor of the visual tracking system, the second image following the first image, determining a first motion blur level of the first image, determining a second motion blur level of the second image, identifying a scale change between the first image and the second image, determining a first optimal scale level for the first image based on the first motion blur level and the scale change, and determining a second optimal scale level for the second image based on the second motion blur level and the scale change.
-
公开(公告)号：WO2022245947A1
公开(公告)日：2022-11-24
申请号：PCT/US2022/029837
申请日：2022-05-18
Applicant: SNAP INC.
Inventor： BORYS, Olha , HALMETSCHLAGER-FUNEK, Georg , KALKGRUBER, Matthias , WOLF, Daniel , ZILLNER, Jakob
IPC: H04N13/239 , H04N13/246 , G06T7/80
Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for misaligned vantage point mitigation for computer stereo vision. A misaligned vantage point mitigation system determines whether vantage points of the optical sensors are misaligned from an expected vantage point and, if so, determines an adjustment variable to mitigate the misalignment based on the location of matching features identified in images captured by both optical sensors.
-
公开(公告)号：WO2022146786A1
公开(公告)日：2022-07-07
申请号：PCT/US2021/064608
申请日：2021-12-21
Applicant: SNAP INC.
Inventor： HALMETSCHLAGER-FUNEK, Georg , KALKGRUBER, Matthias , WOLF, Daniel , ZILLNER, Jakob
IPC: G06F3/01 , G06F3/0346
Abstract: A method for calibrating a visual-inertial tracking system is described. A device operates the visual-inertial tracking system without receiving a tracking request from a virtual object display application. In response to operating the visual-inertial tracking system, the device accesses sensor data from sensors at the device. The device identifies, based on the sensor data, a first calibration parameter value of the visual-inertial tracking system and stores the first calibration parameter value. The system detects a tracking request from the virtual object display application. In response to the tracking request, the system accesses the first calibration parameter value and determines a second calibration parameter value from the first calibration parameter value.
-
公开(公告)号：WO2022005708A1
公开(公告)日：2022-01-06
申请号：PCT/US2021/036322
申请日：2021-06-08
Applicant: SNAP INC.
Inventor： BORYS, Olha , HALMETSCHLAGER-FUNEK, Georg , KALKGRUBER, Matthias , WOLF, Daniel , ZILLNER, Jakob
Abstract: Visual-inertial tracking of an eyewear device using sensors. The eyewear device monitors the sensors of a visual inertial odometry system (VIOS) that provide input for determining a position of the device within its environment. The eyewear device determines the status of the VIOS based information from the sensors and adjusts the plurality of sensors (e.g., by turning on/off sensors, changing the sampling rate, of a combination thereof) based on the determined status. The eyewear device then determines the position of the eyewear device within the environment using the adjusted plurality of sensors.
-
公开(公告)号：WO2022072192A1
公开(公告)日：2022-04-07
申请号：PCT/US2021/051462
申请日：2021-09-22
Applicant: SNAP INC.
Inventor： HALMETSCHLAGER-FUNEK, Georg , HOL, Jeroen , KALKGRUBER, Matthias , KUNTNER, Nikolaj , WOLF, Daniel
IPC: G06T7/73
Abstract: A method and apparatus of tracking poses of a rolling-shutter camera in an augmented reality (AR) system is provided. The method and apparatus use camera information and inertial sensor readings from Inertial Measurement Unit (IMU) to estimate the pose of the camera at a reference line. Thereafter, relative pose changes at scanlines may be calculated using the inertial sensor data. The estimated reference pose of the camera is then further refined based on the visual information from the camera, the relative pose changes and the optimized reference line pose of a previous image. Thereafter, the estimate of the scanline poses may be updated using the relative pose changes obtained in the earlier steps.
-
公开(公告)号：WO2022245564A1
公开(公告)日：2022-11-24
申请号：PCT/US2022/028295
申请日：2022-05-09
Applicant: SNAP INC.
Inventor： HANUMANTE, Sumant , JUNG, Bernhard , KALKGRUBER, Matthias , KONDRATENKO, Anton , LEE KIM-KOON, Edward , NILLES, Gerald , ROBERTSON, John James , RYUMA, Dmitry , SOUROV, Alexander , WOLF, Daniel
IPC: G06F1/20 , G06F1/3287 , G06F1/16 , G02B27/00 , G06F1/3215 , G06F3/01 , G06F1/3234 , G06F3/14
Abstract: Devices and methods for dynamic power configuration (e.g., reduction) for thermal management (e.g., mitigation) in a wearable electronic device such as an eyewear device. The wearable electronic device monitors its temperature and, responsive to the temperature, configures the services is provides to operate in different modes for thermal mitigation (e.g., to prevent overheating). For example, based on temperature, the wearable electronic device adjusts sensors (e.g., turns cameras on or off, changes the sampling rate, or a combination thereof) and adjusts display components (e.g., adjusted rate at which a graphical processing unit generates images and a visual display is updated). This enables the wearable electronic device to consume less power when temperatures are too high in order to provide thermal mitigation.
-
公开(公告)号：WO2022005698A1
公开(公告)日：2022-01-06
申请号：PCT/US2021/036096
申请日：2021-06-07
Applicant: SNAP INC.
Inventor： KALKGRUBER, Matthias , MENDEZ, Erick Mendez , WAGNER, Daniel , WOLF, Daniel , ZHOU, Kai
IPC: G05D1/02 , G01C11/02 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G02B27/0172 , G05D1/0253 , G06F3/012 , H04N5/2252 , H04N5/3532
Abstract: Visual-inertial tracking of an eyewear device using a rolling shutter camera(s). The eyewear device includes a position determining system. Visual-inertial tracking is implemented by sensing motion of the eyewear device. An initial pose is obtained for a rolling shutter camera and an image of an environment is captured. The image includes feature points captured at a particular capture time. A number of poses for the rolling shutter camera is computed based on the initial pose and sensed movement of the device. The number of computed poses is responsive to the sensed movement of the mobile device. A computed pose is selected for each feature point in the image by matching the particular capture time for the feature point to the particular computed time for the computed pose. The position of the mobile device is determined within the environment using the feature points and the selected computed poses for the feature points.
-
公开(公告)号：WO2022245821A1
公开(公告)日：2022-11-24
申请号：PCT/US2022/029629
申请日：2022-05-17
Applicant: SNAP INC.
Inventor： BORYS, Olha , KALKGRUBER, Matthias , WOLF, Daniel
IPC: H04N5/232 , H04N5/23229 , H04N5/23258 , H04N5/23267
Abstract: A method for mitigating motion blur in a visual tracking system is described. In one aspect, a method for selective motion blur mitigation in a visual tracking system includes accessing a first image generated by an optical sensor of the visual tracking system, identifying camera operating parameters of the optical sensor during the optical sensor generating the first image, determining a motion of the optical sensor during the optical sensor generating the first image, determining a motion blur level of the first image based on the camera operating parameters of the optical sensor and the motion of the optical sensor, and determining whether to downscale the first image using a pyramid computation algorithm based on the motion blur level.
-
公开(公告)号：WO2022245648A1
公开(公告)日：2022-11-24
申请号：PCT/US2022/029182
申请日：2022-05-13
Applicant: SNAP INC.
Inventor： DING, Bo , EGRI, Ozi , KALKGRUBER, Matthias , WOLF, Daniel
Abstract: A method for limiting motion blur in a visual tracking system is described. In one aspect, the method includes accessing a first image generated by an optical sensor of the visual tracking system, identifying camera operating parameters of the optical sensor for the first image, determining a motion of the optical sensor for the first image, determining a motion blur level of the first image based on the camera operating parameters of the optical sensor and the motion of the optical sensor, and adjusting the camera operating parameters of the optical sensor based on the motion blur level.
