-
公开(公告)号:US20240341591A1
公开(公告)日:2024-10-17
申请号:US18133870
申请日:2023-04-12
Applicant: Snap Inc.
Inventor: Clemens Birklbauer , Matthias Kalkgruber , Tiago Miguel Pereira Torres , Yubin Xi , Kai Zhou
IPC: A61B3/11
CPC classification number: A61B3/111
Abstract: An eyewear device including a sensor used to measure deformation of an eyewear frame to estimate an inter-pupillary distance (IPD) of an eyewear user. The sensor is used to determine head breadth (HB) of the user and to estimate the IPD of the user. A processor displays an image on a display of the eyewear as a function of the estimated IPD to improve virtual object rendering for an improved augmented reality (AR) viewing experience while reducing vergence accommodation mismatch (VAM). User profile data, such as age and gender, can be used to generate a more accurate estimated IPD of the user.
-
公开(公告)号:US12099195B2
公开(公告)日:2024-09-24
申请号:US18218905
申请日:2023-07-06
Applicant: Snap Inc.
Inventor: Sumant Hanumante , Bernhard Jung , Matthias Kalkgruber , Anton Kondratenko , Edward Lee Kim-Koon , Gerald Nilles , John James Robertson , Dmitry Ryuma , Alexander Sourov , Daniel Wolf
CPC classification number: G02B27/0172 , G01K7/00 , G06F1/26 , G06F3/011 , G06T19/006 , G01K2215/00 , G02B27/0093 , G02B2027/0138 , G02B2027/014 , G02B2027/0178
Abstract: Devices and methods for dynamic power configuration (e.g., reduction) for thermal management (e.g., mitigation) in a wearable electronic device such as an eyewear device. The wearable electronic device monitors its temperature and, responsive to the temperature, configures the services it provides to operate in different modes for thermal mitigation (e.g., to prevent overheating). For example, based on temperature, the wearable electronic device adjusts sensors (e.g., turns cameras on or off, changes the sampling rate, or a combination thereof) and adjusts display components (e.g., adjusted rate at which a graphical processing unit generates images and a visual display is updated). This enables the wearable electronic device to consume less power when temperatures are too high in order to provide thermal mitigation.
-
公开(公告)号:US20240280355A1
公开(公告)日:2024-08-22
申请号:US18172874
申请日:2023-02-22
Applicant: Snap Inc.
Inventor: Matthias Kalkgruber , Tiago Miguel Pereira Torres , Chao Chen , Jason Heger , John Recchio , Mark Kraz , Michael Ryner
CPC classification number: G01B5/30 , G01L1/2206 , G02B27/0176 , G06T19/006 , G02B2027/0178
Abstract: A system for correcting for frame bending of an augmented reality system is provided. A combination of strain gauges and visual inertial odometry is used to determine strains in the frame. An initial model between strain gauge measurements and actual frame spatial relationships is based on finite element analysis or calibration. During an initial visual inertial odometry data calculation phase, the augmented reality system calculates bending or strains of the frame using strain data from the strain gauges mounted to the frame. Subsequent visual inertial odometry data calculations are used to generate a corrected frame model of the frame. The corrected frame model is used for calculating corrected tracking data and corrected virtual overlays that are used to generate virtual overlays used in an AR experience provided by the augmented reality system.
-
公开(公告)号:US20240248531A1
公开(公告)日:2024-07-25
申请号:US18623982
申请日:2024-04-01
Applicant: Snap Inc.
Inventor: Jeroen Diederik Hol , Matthias Kalkgruber , Erick Mendez Mendez , Niall Murphy , Gerald Nilles , Mathieu Emmanuel Vignau
CPC classification number: G06F3/012 , G01C21/1656 , G02B27/0172 , G02B27/0179 , G06F3/14 , G06T7/20 , G02B2027/0138 , G02B2027/014 , G02B2027/0178
Abstract: A method for improving the startup time of a six-degrees of freedom tracking system is described. An augmented reality system receives a device initialization request and activates a first set of sensors in response to the device initialization request. The augmented reality system receives first tracking data from the first set of sensors. The augmented reality system receives an augmented reality experience request and in response to the augmented reality request, causes display of a set of augmented reality content items based on the first tracking data and simultaneously activates a second set of sensors. The augmented reality system receives second tracking data from the activated second set of sensors. The augmented reality system updates the display of the set of augmented reality content items based on the second tracking data.
-
公开(公告)号:US12032168B2
公开(公告)日:2024-07-09
申请号:US18137729
申请日:2023-04-21
Applicant: Snap Inc.
Inventor: Clemens Birklbauer , Georg Halmetschlager-Funek , Jeroen Hol , Matthias Kalkgruber , Daniel Wagner
IPC: G02B27/01 , G06F3/01 , G06T19/00 , H04N13/344
CPC classification number: G02B27/0172 , G02B27/0176 , G06F3/011 , G06F3/017 , G06T19/006 , H04N13/344 , G02B2027/0138 , G02B2027/0154 , G02B2027/0178
Abstract: An eyewear device with flexible frame for Augmented Reality (AR) is disclosed. At least two sensors and a display are mounted on the flexible frame. When in use, the real time geometry of the eyewear device may change from factory calibrated geometry, resulting in low quality AR rendering. A modeling module is provided to model the real time geometry of the eyewear device on the fly using sensor information of the at least two sensors. The modeled real time geometry is then provided to a rendering module to accurately display the AR to the user.
-
公开(公告)号:US11662805B2
公开(公告)日:2023-05-30
申请号:US17301655
申请日:2021-04-09
Applicant: Snap Inc.
Inventor: Georg Halmetschlager-Funek , Matthias Kalkgruber , Daniel Wolf , Jakob Zillner
IPC: G06F3/01 , G06F3/038 , H04L67/131
CPC classification number: G06F3/012 , G06F3/038 , H04L67/131 , G06F2203/0383
Abstract: A method for calibrating a visual-inertial tracking system is described. A device operates the visual-inertial tracking system without receiving a tracking request from a virtual object display application. In response to operating the visual-inertial tracking system, the device accesses sensor data from sensors at the device. The device identifies, based on the sensor data, a first calibration parameter value of the visual-inertial tracking system and stores the first calibration parameter value. The system detects a tracking request from the virtual object display application. In response to the tracking request, the system accesses the first calibration parameter value and determines a second calibration parameter value from the first calibration parameter value.
-
公开(公告)号:US20220377238A1
公开(公告)日:2022-11-24
申请号:US17521109
申请日:2021-11-08
Applicant: Snap Inc.
Inventor: Matthias Kalkgruber , Daniel Wolf
Abstract: A method for mitigating motion blur in a visual-inertial tracking system is described. In one aspect, the method includes accessing a first image generated by an optical sensor of the visual tracking system, accessing a second image generated by the optical sensor of the visual tracking system, the second image following the first image, determining a first motion blur level of the first image, determining a second motion blur level of the second image, identifying a scale change between the first image and the second image, determining a first optimal scale level for the first image based on the first motion blur level and the scale change, and determining a second optimal scale level for the second image based on the second motion blur level and the scale change.
-
公开(公告)号:US20220374091A1
公开(公告)日:2022-11-24
申请号:US17524423
申请日:2021-11-11
Applicant: Snap Inc.
Inventor: Jeroen Diederik Hol , Matthias Kalkgruber
IPC: G06F3/0346 , G06F3/038
Abstract: A method for dynamically initializing a 3 degrees of freedom (3DOF) tracking device is described. In one aspect, the method includes accessing a gyroscope signal from a gyroscope of the 3DOF tracking device, accessing an accelerometer signal from an accelerometer of the 3DOF tracking device, determining an initial state includes a combination of an initial orientation, an initial position, and an initial velocity of the 3DOF tracking device, the initial state indicating a starting condition of the 3DOF tracking device, integrating the gyroscope signal and the accelerometer signal to obtain orientation and position signals using the initial state, and refining an inclination signal of the orientation signal using the position signal.
-
19.
公开(公告)号:US20250037249A1
公开(公告)日:2025-01-30
申请号:US18915975
申请日:2024-10-15
Applicant: Snap Inc.
Inventor: Olha Borys , Matthias Kalkgruber , Daniel Wolf
Abstract: A method for mitigating motion blur in a visual tracking system is described. In one aspect, a method for selective motion blur mitigation in a visual tracking system includes accessing a first image generated by an optical sensor of the visual tracking system, identifying camera operating parameters of the optical sensor during the optical sensor generating the first image, determining a motion of the optical sensor during the optical sensor generating the first image, determining a motion blur level of the first image based on the camera operating parameters of the optical sensor and the motion of the optical sensor, and determining whether to downscale the first image using a pyramid computation algorithm based on the motion blur level.
-
公开(公告)号:US20250008068A1
公开(公告)日:2025-01-02
申请号:US18883717
申请日:2024-09-12
Applicant: Snap Inc.
Inventor: Olha Borys , Georg Halmetschlager-Funek , Matthias Kalkgruber , Daniel Wolf , Jakob Zillner
IPC: H04N13/128 , G06T7/73 , H04N13/00 , H04N13/239
Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for misaligned vantage point mitigation for computer stereo vision. A misaligned vantage point mitigation system determines whether vantage points of the optical sensors are misaligned from an expected vantage point and, if so, determines an adjustment variable to mitigate the misalignment based on the location of matching features identified in images captured by both optical sensors.
-
-
-
-
-
-
-
-
-