-
公开(公告)号:US20250109966A1
公开(公告)日:2025-04-03
申请号:US18477297
申请日:2023-09-28
Applicant: Snap Inc.
Inventor: Clemens Birklbauer , Georg Halmetschlager-Funek , Matthias Kalkgruber , Tiago Miguel Pereira Torres , Simon Schreiberhuber
Abstract: A method for recalibrating an augmented reality (AR) device includes generating and storing a ground truth map of a real-world environment when the AR device is operating with a high likelihood of having an accurate factory calibration. During operation of the AR device, new map data is generated for the real-world environment. The new map data is compared to the ground truth map to detect potential calibration errors. If calibration errors are detected, a recalibration procedure is executed by determining an optimal path through the real-world environment that allows for observing parameters requiring recalibration. Visual cues are generated to guide a user of the AR device through the optimal path. As the user follows the visual cues, calibration parameters are iteratively adjusted to eliminate detected calibration errors. The recalibration procedure may be presented as an interactive game to improve user engagement, with rewards provided for accurately following guidance.
-
公开(公告)号:US20240280814A1
公开(公告)日:2024-08-22
申请号:US18643790
申请日:2024-04-23
Applicant: Snap Inc.
Inventor: Matthias Kalkgruber , Tiago Miguel Pereira Torres , Weston Welge , Ramzi Zahreddine
CPC classification number: G02B27/017 , G02B27/0093 , G06T19/006 , G02B2027/0178
Abstract: A system for deformation or bending correction in an Augmented Reality (AR) system. Sensors are positioned in a frame of a head-worn AR system to sense forces or pressure acting on the frame by temple pieces attached to the frame. The sensed forces or pressure are used in conjunction with a model of the frame to determine a corrected model of the frame. The corrected model is used to correct video data captured by the AR system and to correct a video virtual overlay that is provided to a user wearing the head-worn AR system.
-
公开(公告)号:US20240111156A1
公开(公告)日:2024-04-04
申请号:US17937950
申请日:2022-10-04
Applicant: Snap Inc.
Inventor: Matthias Kalkgruber , Tiago Miguel Pereira Torres , Weston Welge , Ramzi Zahreddine
CPC classification number: G02B27/017 , G02B27/0093 , G06T19/006 , G02B2027/0178
Abstract: A system for deformation or bending correction in an Augmented Reality (AR) system. Sensors are positioned in a frame of a head-worn AR system to sense forces or pressure acting on the frame by temple pieces attached to the frame. The sensed forces or pressure are used in conjunction with a model of the frame to determine a corrected model of the frame. The corrected model is used to correct video data captured by the AR system and to correct a video virtual overlay that is provided to a user wearing the head-worn AR system.
-
公开(公告)号:US12271517B1
公开(公告)日:2025-04-08
申请号:US18478352
申请日:2023-09-29
Applicant: Snap Inc.
Inventor: Thomas Faeulhammer , Matthias Kalkgruber , Thomas Muttenthaler , Tiago Miguel Pereira Torres , Daniel Wolf
Abstract: Bending data is used to facilitate tracking operations of an extended reality (XR) device, such as hand tracking or other object tracking operations. The XR device obtains bending data indicative of bending of the XR device to accommodate a body part of a user wearing the XR device. The XR device determines, based on the bending data, whether to use previously identified biometric data in a tracking operation. A mode of the XR device is selected responsive to determining whether to use the previously identified biometric data. The selected mode is used to initialize the tracking operation. The selected mode may be a first mode in which the previously identified biometric data is used in the tracking operation or a second mode in which the previously identified biometric data is not used in the tracking operation.
-
公开(公告)号:US20240341591A1
公开(公告)日:2024-10-17
申请号:US18133870
申请日:2023-04-12
Applicant: Snap Inc.
Inventor: Clemens Birklbauer , Matthias Kalkgruber , Tiago Miguel Pereira Torres , Yubin Xi , Kai Zhou
IPC: A61B3/11
CPC classification number: A61B3/111
Abstract: An eyewear device including a sensor used to measure deformation of an eyewear frame to estimate an inter-pupillary distance (IPD) of an eyewear user. The sensor is used to determine head breadth (HB) of the user and to estimate the IPD of the user. A processor displays an image on a display of the eyewear as a function of the estimated IPD to improve virtual object rendering for an improved augmented reality (AR) viewing experience while reducing vergence accommodation mismatch (VAM). User profile data, such as age and gender, can be used to generate a more accurate estimated IPD of the user.
-
公开(公告)号:US20240280355A1
公开(公告)日:2024-08-22
申请号:US18172874
申请日:2023-02-22
Applicant: Snap Inc.
Inventor: Matthias Kalkgruber , Tiago Miguel Pereira Torres , Chao Chen , Jason Heger , John Recchio , Mark Kraz , Michael Ryner
CPC classification number: G01B5/30 , G01L1/2206 , G02B27/0176 , G06T19/006 , G02B2027/0178
Abstract: A system for correcting for frame bending of an augmented reality system is provided. A combination of strain gauges and visual inertial odometry is used to determine strains in the frame. An initial model between strain gauge measurements and actual frame spatial relationships is based on finite element analysis or calibration. During an initial visual inertial odometry data calculation phase, the augmented reality system calculates bending or strains of the frame using strain data from the strain gauges mounted to the frame. Subsequent visual inertial odometry data calculations are used to generate a corrected frame model of the frame. The corrected frame model is used for calculating corrected tracking data and corrected virtual overlays that are used to generate virtual overlays used in an AR experience provided by the augmented reality system.
-
公开(公告)号:US20240312145A1
公开(公告)日:2024-09-19
申请号:US18184333
申请日:2023-03-15
Applicant: Snap Inc.
CPC classification number: G06T19/006 , G01C21/1652 , G01C21/1656 , G02B27/0172 , G06V10/761 , G02B2027/0178
Abstract: A method for correcting bending of a flexible display device is described. The method includes forming a plurality of sensor groups of an augmented reality (AR) display device, where one of the plurality of sensor groups includes a combination of a camera, an IMU (inertial measurement unit), and a component, each being tightly coupled to each other, a spatial relationship between the camera, the IMU sensor, or the component being predefined, accessing sensor groups data from the plurality of sensor groups, estimating a spatial relationship between the plurality of sensor groups based on the sensor groups data, and displaying virtual content in a display of the AR display device based on the spatial relationship between the plurality of sensor groups.
-
公开(公告)号:US20240192024A1
公开(公告)日:2024-06-13
申请号:US18063450
申请日:2022-12-08
Applicant: Snap Inc.
Inventor: Georg Halmetschlager-Funek , Jeroen Diederik Hol , Matthias Kalkgruber , Tiago Miguel Pereira Torres
CPC classification number: G01C25/005 , G01C21/1656 , G06F3/012
Abstract: A method for calibrating a visual-inertial tracking system is described. In one aspect, a method includes measuring a temperature of an inertial measurement unit (IMU) of a visual-inertial tracking system, identifying, from an IMU parametric model of an IMU calibration module, an IMU intrinsic parameter estimate corresponding to the temperature, determining an online IMU intrinsic parameter estimate by operating the visual-inertial tracking system with the IMU intrinsic parameter estimate, providing the online IMU intrinsic parameter estimate to the IMU calibration module, and updating and incorporating the IMU parametric model with the online IMU intrinsic parameter estimate.
-
公开(公告)号:US11988833B2
公开(公告)日:2024-05-21
申请号:US17937950
申请日:2022-10-04
Applicant: Snap Inc.
Inventor: Matthias Kalkgruber , Tiago Miguel Pereira Torres , Weston Welge , Ramzi Zahreddine
CPC classification number: G02B27/017 , G02B27/0093 , G06T19/006 , G02B2027/0178
Abstract: A system for deformation or bending correction in an Augmented Reality (AR) system. Sensors are positioned in a frame of a head-worn AR system to sense forces or pressure acting on the frame by temple pieces attached to the frame. The sensed forces or pressure are used in conjunction with a model of the frame to determine a corrected model of the frame. The corrected model is used to correct video data captured by the AR system and to correct a video virtual overlay that is provided to a user wearing the head-worn AR system.
-
-
-
-
-
-
-
-