-
公开(公告)号:US12014523B2
公开(公告)日:2024-06-18
申请号:US18198414
申请日:2023-05-17
Applicant: Snap Inc.
Inventor: Clemens Birklbauer , Georg Halmetschlager-Funek , Matthias Kalkgruber , Kai Zhou
CPC classification number: G06T7/80 , G06V10/443 , H04N17/002 , H04N23/61 , H04N23/651 , H04N23/6812
Abstract: A method for adjusting camera intrinsic parameters of a multi-camera visual tracking device is described. In one aspect, a method for calibrating the multi-camera visual tracking system includes disabling a first camera of the multi-camera visual tracking system while a second camera of the multi-camera visual tracking system is enabled, detecting a first set of features in a first image generated by the first camera after detecting that the temperature of the first camera is within the threshold of the factory calibration temperature of the first camera, and accessing and correcting intrinsic parameters of the second camera based on the projection of the first set of features in the second image and a second set of features in the second image.
-
公开(公告)号:US20240289988A1
公开(公告)日:2024-08-29
申请号:US18656268
申请日:2024-05-06
Applicant: Snap Inc.
Inventor: Clemens Birklbauer , Georg Halmetschlager-Funek , Matthias Kalkgruber , Kai Zhou
CPC classification number: G06T7/80 , G06V10/443 , H04N17/002 , H04N23/61 , H04N23/651 , H04N23/6812
Abstract: A method for adjusting camera intrinsic parameters of a multi-camera visual tracking device is described. In one aspect, a method for calibrating the multi-camera visual tracking system includes disabling a first camera of the multi-camera visual tracking system while a second camera of the multi-camera visual tracking system is enabled, detecting a first set of features in a first image generated by the first camera after detecting that the temperature of the first camera is within the threshold of the factory calibration temperature of the first camera, and accessing and correcting intrinsic parameters of the second camera based on the projection of the first set of features in the second image and a second set of features in the second image.
-
公开(公告)号:US11662589B2
公开(公告)日:2023-05-30
申请号:US17588641
申请日:2022-01-31
Applicant: Snap Inc.
Inventor: Clemens Birklbauer , Georg Halmetschlager-Funek , Jeroen Hol , Matthias Kalkgruber , Daniel Wagner
IPC: G02B27/01 , H04N13/344 , G06T19/00 , G06F3/01
CPC classification number: G02B27/0172 , G02B27/0176 , G06F3/011 , G06F3/017 , G06T19/006 , H04N13/344 , G02B2027/0138 , G02B2027/0154 , G02B2027/0178
Abstract: An eyewear device with flexible frame for Augmented Reality (AR) is disclosed. At least two sensors and a display are mounted on the flexible frame. When in use, the real time geometry of the eyewear device may change from factory calibrated geometry, resulting in low quality AR rendering. A modeling module is provided to model the real time geometry of the eyewear device on the fly using sensor information of the at least two sensors. The modeled real time geometry is then provided to a rendering module to accurately display the AR to the user.
-
公开(公告)号:US20230360267A1
公开(公告)日:2023-11-09
申请号:US18198414
申请日:2023-05-17
Applicant: Snap Inc.
Inventor: Clemens Birklbauer , Georg Halmetschlager-Funek , Matthias Kalkgruber , Kai Zhou
CPC classification number: G06T7/80 , G06V10/443 , H04N17/002 , H04N23/61 , H04N23/651 , H04N23/6812
Abstract: A method for adjusting camera intrinsic parameters of a multi-camera visual tracking device is described. In one aspect, a method for calibrating the multi-camera visual tracking system includes disabling a first camera of the multi-camera visual tracking system while a second camera of the multi-camera visual tracking system is enabled, detecting a first set of features in a first image generated by the first camera after detecting that the temperature of the first camera is within the threshold of the factory calibration temperature of the first camera, and accessing and correcting intrinsic parameters of the second camera based on the projection of the first set of features in the second image and a second set of features in the second image.
-
公开(公告)号:US20230296902A1
公开(公告)日:2023-09-21
申请号:US18137729
申请日:2023-04-21
Applicant: Snap Inc.
Inventor: Clemens Birklbauer , Georg Halmetschlager-Funek , Jeroen Hol , Matthias Kalkgruber , Daniel Wagner
IPC: G02B27/01 , H04N13/344 , G06T19/00 , G06F3/01
CPC classification number: G02B27/0172 , G02B27/0176 , G06F3/011 , G06F3/017 , G06T19/006 , H04N13/344 , G02B2027/0138 , G02B2027/0154 , G02B2027/0178
Abstract: An eyewear device with flexible frame for Augmented Reality (AR) is disclosed. At least two sensors and a display are mounted on the flexible frame. When in use, the real time geometry of the eyewear device may change from factory calibrated geometry, resulting in low quality AR rendering. A modeling module is provided to model the real time geometry of the eyewear device on the fly using sensor information of the at least two sensors. The modeled real time geometry is then provided to a rendering module to accurately display the AR to the user.
-
公开(公告)号:US20220375128A1
公开(公告)日:2022-11-24
申请号:US17448655
申请日:2021-09-23
Applicant: Snap Inc.
Inventor: Clemens Birklbauer , Georg Halmetschlager-Funek , Matthias Kalkgruber , Kai Zhou
Abstract: A method for adjusting camera intrinsic parameters of a multi-camera visual tracking device is described. In one aspect, a method for calibrating the multi-camera visual tracking system includes disabling a first camera of the multi-camera visual tracking system while a second camera of the multi-camera visual tracking system is enabled, detecting a first set of features in a first image generated by the first camera after detecting that the temperature of the first camera is within the threshold of the factory calibration temperature of the first camera, and accessing and correcting intrinsic parameters of the second camera based on the projection of the first set of features in the second image and a second set of features in the second image.
-
公开(公告)号:US20240341591A1
公开(公告)日:2024-10-17
申请号:US18133870
申请日:2023-04-12
Applicant: Snap Inc.
Inventor: Clemens Birklbauer , Matthias Kalkgruber , Tiago Miguel Pereira Torres , Yubin Xi , Kai Zhou
IPC: A61B3/11
CPC classification number: A61B3/111
Abstract: An eyewear device including a sensor used to measure deformation of an eyewear frame to estimate an inter-pupillary distance (IPD) of an eyewear user. The sensor is used to determine head breadth (HB) of the user and to estimate the IPD of the user. A processor displays an image on a display of the eyewear as a function of the estimated IPD to improve virtual object rendering for an improved augmented reality (AR) viewing experience while reducing vergence accommodation mismatch (VAM). User profile data, such as age and gender, can be used to generate a more accurate estimated IPD of the user.
-
公开(公告)号:US12108027B2
公开(公告)日:2024-10-01
申请号:US18141833
申请日:2023-05-01
Applicant: Snap Inc.
Inventor: Clemens Birklbauer , Alexander Kane , Dominik Schnitzer
IPC: H04N17/00 , H04N23/56 , H04N25/531
CPC classification number: H04N17/002 , H04N23/56 , H04N25/531
Abstract: Camera pipeline exposure timestamp error determination methods and systems that detect latency in rolling shutter camera systems. The exposure timestamp error determination system includes a rolling shutter image sensor configured to capture an image and a processor. The processor determines timestamp error by capturing the image using the rolling shutter image sensor where the image includes a bar code encoded with a barcode timestamp. The processor then obtains a system exposure timestamp corresponding to capture of the image by the rolling shutter image sensor and the barcode timestamp by decoding the bar code. Pipeline exposure timestamp error is then determined for the rolling shutter camera system by comparing the obtained barcode timestamp to the system exposure timestamp.
-
公开(公告)号:US12032168B2
公开(公告)日:2024-07-09
申请号:US18137729
申请日:2023-04-21
Applicant: Snap Inc.
Inventor: Clemens Birklbauer , Georg Halmetschlager-Funek , Jeroen Hol , Matthias Kalkgruber , Daniel Wagner
IPC: G02B27/01 , G06F3/01 , G06T19/00 , H04N13/344
CPC classification number: G02B27/0172 , G02B27/0176 , G06F3/011 , G06F3/017 , G06T19/006 , H04N13/344 , G02B2027/0138 , G02B2027/0154 , G02B2027/0178
Abstract: An eyewear device with flexible frame for Augmented Reality (AR) is disclosed. At least two sensors and a display are mounted on the flexible frame. When in use, the real time geometry of the eyewear device may change from factory calibrated geometry, resulting in low quality AR rendering. A modeling module is provided to model the real time geometry of the eyewear device on the fly using sensor information of the at least two sensors. The modeled real time geometry is then provided to a rendering module to accurately display the AR to the user.
-
公开(公告)号:US20250109966A1
公开(公告)日:2025-04-03
申请号:US18477297
申请日:2023-09-28
Applicant: Snap Inc.
Inventor: Clemens Birklbauer , Georg Halmetschlager-Funek , Matthias Kalkgruber , Tiago Miguel Pereira Torres , Simon Schreiberhuber
Abstract: A method for recalibrating an augmented reality (AR) device includes generating and storing a ground truth map of a real-world environment when the AR device is operating with a high likelihood of having an accurate factory calibration. During operation of the AR device, new map data is generated for the real-world environment. The new map data is compared to the ground truth map to detect potential calibration errors. If calibration errors are detected, a recalibration procedure is executed by determining an optimal path through the real-world environment that allows for observing parameters requiring recalibration. Visual cues are generated to guide a user of the AR device through the optimal path. As the user follows the visual cues, calibration parameters are iteratively adjusted to eliminate detected calibration errors. The recalibration procedure may be presented as an interactive game to improve user engagement, with rewards provided for accurately following guidance.
-
-
-
-
-
-
-
-
-