-
公开(公告)号:US12072486B2
公开(公告)日:2024-08-27
申请号:US18113278
申请日:2023-02-23
Applicant: Snap Inc.
Inventor: Jeffrey Michael DeWall , Dominik Schnitzer , Amit Singh , Daniel Wagner
CPC classification number: G02B27/0025 , G02B27/0018 , G02B27/0172 , G02B2027/0138
Abstract: A method for configuring a digital light projector (DLP) of an augmented reality (AR) display device is described. A light source component of the DLP projector is configured to generate a single red-green-blue color sequence repetition per image frame. The AR display device identifies a color sequence of the light source component of the DLP projector and tracks a motion of the AR display device. The AR display device adjusts an operation of the DLP projector based on the single red-green-blue color sequence repetition, the color sequence of the light source component of the DLP projector, and the motion of the AR display device.
-
公开(公告)号:US12032168B2
公开(公告)日:2024-07-09
申请号:US18137729
申请日:2023-04-21
Applicant: Snap Inc.
Inventor: Clemens Birklbauer , Georg Halmetschlager-Funek , Jeroen Hol , Matthias Kalkgruber , Daniel Wagner
IPC: G02B27/01 , G06F3/01 , G06T19/00 , H04N13/344
CPC classification number: G02B27/0172 , G02B27/0176 , G06F3/011 , G06F3/017 , G06T19/006 , H04N13/344 , G02B2027/0138 , G02B2027/0154 , G02B2027/0178
Abstract: An eyewear device with flexible frame for Augmented Reality (AR) is disclosed. At least two sensors and a display are mounted on the flexible frame. When in use, the real time geometry of the eyewear device may change from factory calibrated geometry, resulting in low quality AR rendering. A modeling module is provided to model the real time geometry of the eyewear device on the fly using sensor information of the at least two sensors. The modeled real time geometry is then provided to a rendering module to accurately display the AR to the user.
-
公开(公告)号:US20240221220A1
公开(公告)日:2024-07-04
申请号:US18442772
申请日:2024-02-15
Applicant: Snap Inc.
Inventor: Branislav Micusik , Georgios Evangelidis , Daniel Wagner
CPC classification number: G06T7/80 , G02B27/017 , G06T7/70 , G06T19/006 , H04N23/54 , G05G9/04737 , G06T2207/30241 , G06T2207/30244
Abstract: Eyewear providing an interactive augmented reality experience between two eyewear devices by using alignment between respective 6DOF trajectories, also referred to herein as ego motion alignment. An eyewear device of user A and an eyewear device of user B track the eyewear device of the other user, or an object of the other user, such as on the user's face, to provide the collaborative AR experience. This enables sharing common three-dimensional content between multiple eyewear users without using or aligning the eyewear devices to common image content such as a marker, which is a more lightweight solution with reduced computational burden on a processor. An inertial measurement unit may also be used to align the eyewear devices.
-
公开(公告)号:US20240177328A1
公开(公告)日:2024-05-30
申请号:US18435797
申请日:2024-02-07
Applicant: Snap Inc.
Inventor: Olha Borys , Ilteris Kaan Canberk , Daniel Wagner , Jakob Zillner
IPC: G06T7/593 , G06T7/73 , G06T15/00 , H04N13/00 , H04N13/128 , H04N13/204
CPC classification number: G06T7/593 , G06T7/73 , G06T15/00 , H04N13/128 , H04N13/204 , G06T2207/10012 , H04N2013/0081
Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for continuous surface and depth estimation. A continuous surface and depth estimation system determines the depth and surface normal of physical objects by using stereo vision limited within a predetermined window.
-
公开(公告)号:US20240369829A1
公开(公告)日:2024-11-07
申请号:US18775292
申请日:2024-07-17
Applicant: Snap Inc.
Inventor: Jeffrey Michael DeWall , Dominik Schnitzer , Amit Singh , Daniel Wagner
Abstract: A method for configuring a digital light projector (DLP) of an augmented reality (AR) display device is described. A light source component of the DLP projector is configured to generate a single red-green-blue color sequence repetition per image frame. The AR display device identifies a color sequence of the light source component of the DLP projector and tracks a motion of the AR display device. The AR display device adjusts an operation of the DLP projector based on the single red-green-blue color sequence repetition, the color sequence of the light source component of the DLP projector, and the motion of the AR display device.
-
公开(公告)号:US20240362743A1
公开(公告)日:2024-10-31
申请号:US18768841
申请日:2024-07-10
Applicant: Snap Inc.
Inventor: Bernhard Jung , Daniel Wagner
CPC classification number: G06T3/18 , G06T13/40 , G06T13/80 , G06T15/205 , G06T2210/44
Abstract: A method for minimizing latency of moving objects in an augmented reality (AR) display device is described. In one aspect, the method includes determining an initial pose of a visual tracking device, identifying an initial location of an object in an image that is generated by an optical sensor of the visual tracking device, the image corresponding to the initial pose of the visual tracking device. rendering virtual content based on the initial pose and the initial location of the object, retrieving an updated pose of the visual tracking device, tracking an updated location of the object in an updated image that corresponds to the updated pose, and applying a time warp transformation to the rendered virtual content based on the updated pose and the updated location of the object to generate transformed virtual content.
-
公开(公告)号:US20240314461A1
公开(公告)日:2024-09-19
申请号:US18677296
申请日:2024-05-29
Applicant: Snap Inc.
Inventor: Matthias Kalkgruber , Erick Mendez Mendez , Daniel Wagner , Daniel Wolf , Kai Zhou
IPC: H04N25/531 , G02B27/01 , H04N23/51
CPC classification number: H04N25/531 , G02B27/0172 , H04N23/51 , G02B2027/0138 , G02B2027/014 , G02B2027/0178
Abstract: Visual-inertial tracking of an eyewear device using a rolling shutter camera(s). The device includes a position determining system. Visual-inertial tracking is implemented by sensing motion of the device. An initial pose is obtained for a rolling shutter camera and an image of an environment is captured. The image includes feature points captured at a particular capture time. A number of poses for the rolling shutter camera is computed based on the initial pose and sensed movement of the device. The number of computed poses is responsive to the sensed movement of the mobile device. A computed pose is selected for each feature point in the image by matching the particular capture time for the feature point to the particular computed time for the computed pose. The position of the mobile device is determined within the environment using the feature points and the selected computed poses for the feature points.
-
公开(公告)号:US12002168B2
公开(公告)日:2024-06-04
申请号:US17844541
申请日:2022-06-20
Applicant: Snap Inc.
Inventor: Jan Bajana , Bernhard Jung , Daniel Wagner
CPC classification number: G06T19/006 , G06T7/20 , G06T15/005 , G06T2200/28 , G06T2207/30196
Abstract: A method for reducing motion-to-photon latency for hand tracking is described. In one aspect, a method includes accessing a first frame from a camera of an Augmented Reality (AR) device, tracking a first image of a hand in the first frame, rendering virtual content based on the tracking of the first image of the hand in the first frame, accessing a second frame from the camera before the rendering of the virtual content is completed, the second frame immediately following the first frame, tracking, using the computer vision engine of the AR device, a second image of the hand in the second frame, generating an annotation based on tracking the second image of the hand in the second frame, forming an annotated virtual content based on the annotation and the virtual content, and displaying the annotated virtual content in a display of the AR device.
-
公开(公告)号:US11961251B2
公开(公告)日:2024-04-16
申请号:US17747592
申请日:2022-05-18
Applicant: Snap Inc.
Inventor: Olha Borys , Ilteris Kaan Canberk , Daniel Wagner , Jakob Zillner
IPC: H04N13/128 , G06T7/593 , G06T7/73 , G06T15/00 , H04N13/204 , H04N13/00
CPC classification number: G06T7/593 , G06T7/73 , G06T15/00 , H04N13/128 , H04N13/204 , G06T2207/10012 , H04N2013/0081
Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for continuous surface and depth estimation. A continuous surface and depth estimation system determines the depth and surface normal of physical objects by using stereo vision limited within a predetermined window.
-
公开(公告)号:US20230296902A1
公开(公告)日:2023-09-21
申请号:US18137729
申请日:2023-04-21
Applicant: Snap Inc.
Inventor: Clemens Birklbauer , Georg Halmetschlager-Funek , Jeroen Hol , Matthias Kalkgruber , Daniel Wagner
IPC: G02B27/01 , H04N13/344 , G06T19/00 , G06F3/01
CPC classification number: G02B27/0172 , G02B27/0176 , G06F3/011 , G06F3/017 , G06T19/006 , H04N13/344 , G02B2027/0138 , G02B2027/0154 , G02B2027/0178
Abstract: An eyewear device with flexible frame for Augmented Reality (AR) is disclosed. At least two sensors and a display are mounted on the flexible frame. When in use, the real time geometry of the eyewear device may change from factory calibrated geometry, resulting in low quality AR rendering. A modeling module is provided to model the real time geometry of the eyewear device on the fly using sensor information of the at least two sensors. The modeled real time geometry is then provided to a rendering module to accurately display the AR to the user.
-
-
-
-
-
-
-
-
-