-
公开(公告)号:US12260016B2
公开(公告)日:2025-03-25
申请号:US18623982
申请日:2024-04-01
Applicant: Snap Inc.
Inventor: Jeroen Diederik Hol , Matthias Kalkgruber , Erick Mendez Mendez , Niall Murphy , Gerald Nilles , Mathieu Emmanuel Vignau
Abstract: A method for improving the startup time of a six-degrees of freedom tracking system is described. An augmented reality system receives a device initialization request and activates a first set of sensors in response to the device initialization request. The augmented reality system receives first tracking data from the first set of sensors. The augmented reality system receives an augmented reality experience request and in response to the augmented reality request, causes display of a set of augmented reality content items based on the first tracking data and simultaneously activates a second set of sensors. The augmented reality system receives second tracking data from the activated second set of sensors. The augmented reality system updates the display of the set of augmented reality content items based on the second tracking data.
-
公开(公告)号:US20240329409A1
公开(公告)日:2024-10-03
申请号:US18742166
申请日:2024-06-13
Applicant: Snap Inc.
Inventor: Clemens Birklbauer , Georg Halmetschlager-Funek , Jeroen Hol , Matthias Kalkgruber , Daniel Wagner
IPC: G02B27/01 , G06F3/01 , G06T19/00 , H04N13/344
CPC classification number: G02B27/0172 , G02B27/0176 , G06F3/011 , G06F3/017 , G06T19/006 , H04N13/344 , G02B2027/0138 , G02B2027/0154 , G02B2027/0178
Abstract: An eyewear device with flexible frame for Augmented Reality (AR) is disclosed. At least two sensors and a display are mounted on the flexible frame. When in use, the real time geometry of the eyewear device may change from factory calibrated geometry, resulting in low quality AR rendering. A modeling module is provided to model the real time geometry of the eyewear device on the fly using sensor information of the at least two sensors. The modeled real time geometry is then provided to a rendering module to accurately display the AR to the user.
-
公开(公告)号:US20230388632A1
公开(公告)日:2023-11-30
申请号:US18233729
申请日:2023-08-14
Applicant: Snap Inc.
Inventor: Bo Ding , Ozi Egri , Matthias Kalkgruber , Daniel Wolf
IPC: H04N23/68
CPC classification number: H04N23/6811 , H04N23/684 , H04N23/6812 , G06T19/006
Abstract: A method for limiting motion blur in a visual tracking system is described. In one aspect, the method includes accessing a first image generated by an optical sensor of the visual tracking system, identifying camera operating parameters of the optical sensor for the first image, determining a motion of the optical sensor for the first image, determining a motion blur level of the first image based on the camera operating parameters of the optical sensor and the motion of the optical sensor, and adjusting the camera operating parameters of the optical sensor based on the motion blur level.
-
公开(公告)号:US11719939B2
公开(公告)日:2023-08-08
申请号:US17739551
申请日:2022-05-09
Applicant: Snap Inc.
Inventor: Sumant Hanumante , Bernhard Jung , Matthias Kalkgruber , Anton Kondratenko , Edward Lee Kim-Koon , Gerald Nilles , John James Robertson , Dmitry Ryuma , Alexander Sourov , Daniel Wolf
CPC classification number: G02B27/0172 , G01K7/00 , G06F1/26 , G06F3/011 , G06T19/006 , G01K2215/00 , G02B27/0093 , G02B2027/014 , G02B2027/0138 , G02B2027/0178
Abstract: Devices and methods for dynamic power configuration (e.g., reduction) for thermal management (e.g., mitigation) in a wearable electronic device such as an eyewear device. The wearable electronic device monitors its temperature and, responsive to the temperature, configures the services is provides to operate in different modes for thermal mitigation (e.g., to prevent overheating). For example, based on temperature, the wearable electronic device adjusts sensors (e.g., turns cameras on or off, changes the sampling rate, or a combination thereof) and adjusts display components (e.g., adjusted rate at which a graphical processing unit generates images and a visual display is updated). This enables the wearable electronic device to consume less power when temperatures are too high in order to provide thermal mitigation.
-
公开(公告)号:US11688101B2
公开(公告)日:2023-06-27
申请号:US17448655
申请日:2021-09-23
Applicant: Snap Inc.
Inventor: Clemens Birklbauer , Georg Halmetschlager-Funek , Matthias Kalkgruber , Kai Zhou
CPC classification number: G06T7/80 , G06V10/443 , H04N17/002 , H04N23/61 , H04N23/651 , H04N23/6812
Abstract: A method for adjusting camera intrinsic parameters of a multi-camera visual tracking device is described. In one aspect, a method for calibrating the multi-camera visual tracking system includes disabling a first camera of the multi-camera visual tracking system while a second camera of the multi-camera visual tracking system is enabled, detecting a first set of features in a first image generated by the first camera after detecting that the temperature of the first camera is within the threshold of the factory calibration temperature of the first camera, and accessing and correcting intrinsic parameters of the second camera based on the projection of the first set of features in the second image and a second set of features in the second image.
-
公开(公告)号:US11681361B2
公开(公告)日:2023-06-20
申请号:US17743194
申请日:2022-05-12
Applicant: Snap Inc.
Inventor: Jeroen Diederik Hol , Matthias Kalkgruber , Erick Mendez Mendez , Niall Murphy , Gerald Nilles , Mathieu Emmanuel Vignau
CPC classification number: G06F3/012 , G01C21/1656 , G02B27/0172 , G02B27/0179 , G06F3/14 , G06T7/20 , G02B2027/014 , G02B2027/0138 , G02B2027/0178
Abstract: A method for improving the startup time of a six-degrees of freedom tracking system is described. An augmented reality system receives a device initialization request and activates a first set of sensors in response to the device initialization request. The augmented reality system receives first tracking data from the first set of sensors. The augmented reality system receives an augmented reality experience request and in response to the augmented reality request, causes display of a set of augmented reality content items based on the first tracking data and simultaneously activates a second set of sensors. The augmented reality system receives second tracking data from the activated second set of sensors. The augmented reality system updates the display of the set of augmented reality content items based on the second tracking data.
-
公开(公告)号:US20220365348A1
公开(公告)日:2022-11-17
申请号:US17739551
申请日:2022-05-09
Applicant: Snap Inc.
Inventor: Sumant Hanumante , Bernhard Jung , Matthias Kalkgruber , Anton Kondratenko , Edward Lee Kim-Koon , Gerald Nilles , John James Robertson , Dmitry Ryuma , Alexander Sourov , Daniel Wolf
Abstract: Devices and methods for dynamic power configuration (e.g., reduction) for thermal management (e.g., mitigation) in a wearable electronic device such as an eyewear device. The wearable electronic device monitors its temperature and, responsive to the temperature, configures the services is provides to operate in different modes for thermal mitigation (e.g., to prevent overheating). For example, based on temperature, the wearable electronic device adjusts sensors (e.g., turns cameras on or off, changes the sampling rate, or a combination thereof) and adjusts display components (e.g., adjusted rate at which a graphical processing unit generates images and a visual display is updated). This enables the wearable electronic device to consume less power when temperatures are too high in order to provide thermal mitigation.
-
公开(公告)号:US12260588B2
公开(公告)日:2025-03-25
申请号:US18373554
申请日:2023-09-27
Applicant: Snap Inc.
Inventor: Sagi Katz , Matthias Kalkgruber
IPC: G06T7/33 , G06T7/593 , G06T7/73 , G06T19/00 , H04N13/239
Abstract: A method for correcting a bending of a flexible device is described. In one aspect, the method includes accessing feature data of a first stereo frame that is generated by stereo optical sensors of the flexible device, the feature data generated based on a visual-inertial odometry (VIO) system of the flexible device, accessing depth map data of the first stereo frame, the depth map data generated based on a depth map system of the flexible device, estimating a pitch-roll bias and a yaw bias based on the features data and the depth map data of the first stereo frame, and generating a second stereo frame after the first stereo frame, the second stereo frame based on the pitch-roll bias and the yaw bias of the first stereo frame.
-
9.
公开(公告)号:US12148128B2
公开(公告)日:2024-11-19
申请号:US17521081
申请日:2021-11-08
Applicant: Snap Inc.
Inventor: Olha Borys , Matthias Kalkgruber , Daniel Wolf
Abstract: A method for mitigating motion blur in a visual tracking system is described. In one aspect, a method for selective motion blur mitigation in a visual tracking system includes accessing a first image generated by an optical sensor of the visual tracking system, identifying camera operating parameters of the optical sensor during the optical sensor generating the first image, determining a motion of the optical sensor during the optical sensor generating the first image, determining a motion blur level of the first image based on the camera operating parameters of the optical sensor and the motion of the optical sensor, and determining whether to downscale the first image using a pyramid computation algorithm based on the motion blur level.
-
公开(公告)号:US12126783B2
公开(公告)日:2024-10-22
申请号:US17747564
申请日:2022-05-18
Applicant: Snap Inc.
Inventor: Olha Borys , Georg Halmetschlager-Funek , Matthias Kalkgruber , Daniel Wolf , Jakob Zillner
IPC: H04N13/128 , G06T7/73 , H04N13/239 , H04N13/00
CPC classification number: H04N13/128 , G06T7/73 , H04N13/239 , G06T2207/10012 , G06T2207/20228 , H04N2013/0081
Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for misaligned vantage point mitigation for computer stereo vision. A misaligned vantage point mitigation system determines whether vantage points of the optical sensors are misaligned from an expected vantage point and, if so, determines an adjustment variable to mitigate the misalignment based on the location of matching features identified in images captured by both optical sensors.
-
-
-
-
-
-
-
-
-