-
公开(公告)号:US11974060B2
公开(公告)日:2024-04-30
申请号:US18129009
申请日:2023-03-30
Applicant: Snap Inc.
Inventor: Sagi Katz , Daniel Wagner , Weston Welge
CPC classification number: H04N5/2226 , H04N23/45 , H04N23/672
Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for varied depth determination using, stereo vision and phase detection auto focus (PDAF). Computer stereo vision (stereo vision) is used to extract three-dimensional information from digital images. To utilize stereo vison, two optical sensors are displaced horizontally from one another and used to capture images depicting two differing views of a real-world environment from two different vantage points. The relative depth of the objects captured in the images is determined using triangulation by comparing the relative positions of the objects in the two images. For example, the relative positions of matching objects (e.g., features) identified in the captured images are used along with the known orientation of the optical sensors (e.g., distance between the optical sensors, vantage points the optical sensors) to estimate the depth of the objects.
-
公开(公告)号:US11915453B2
公开(公告)日:2024-02-27
申请号:US18106655
申请日:2023-02-07
Applicant: Snap Inc.
Inventor: Branislav Micusik , Georgios Evangelidis , Daniel Wagner
CPC classification number: G06T7/80 , G02B27/017 , G06T7/70 , G06T19/006 , H04N23/54 , G05G9/04737 , G06T2207/30241 , G06T2207/30244
Abstract: Eyewear providing an interactive augmented reality experience between two eyewear devices by using alignment between respective 6DOF trajectories, also referred to herein as ego motion alignment. An eyewear device of user A and an eyewear device of user B track the eyewear device of the other user, or an object of the other user, such as on the user's face, to provide the collaborative AR experience. This enables sharing common three-dimensional content between multiple eyewear users without using or aligning the eyewear devices to common image content such as a marker, which is a more lightweight solution with reduced computational burden on a processor. An inertial measurement unit may also be used to align the eyewear devices.
-
公开(公告)号:US20230177708A1
公开(公告)日:2023-06-08
申请号:US18061775
申请日:2022-12-05
Applicant: Snap Inc.
Inventor: Erick Mendez Mendez , Isac Andreas Müller Sandvik , Qi Pan , Edward James Rosten , Andrew Tristan Spek , Daniel Wagner , Jakob Zillner
Abstract: A depth estimation system to perform operations that include: receiving image data generated by a client device, the image data comprising a depiction of an environment; identifying a set of image features based on the image data; determining a pose of the client device based on the set of features; generating a depth estimation based on the image data and the pose of the client device; and generating a mesh model of the environment based on the depth estimation.
-
公开(公告)号:US11662589B2
公开(公告)日:2023-05-30
申请号:US17588641
申请日:2022-01-31
Applicant: Snap Inc.
Inventor: Clemens Birklbauer , Georg Halmetschlager-Funek , Jeroen Hol , Matthias Kalkgruber , Daniel Wagner
IPC: G02B27/01 , H04N13/344 , G06T19/00 , G06F3/01
CPC classification number: G02B27/0172 , G02B27/0176 , G06F3/011 , G06F3/017 , G06T19/006 , H04N13/344 , G02B2027/0138 , G02B2027/0154 , G02B2027/0178
Abstract: An eyewear device with flexible frame for Augmented Reality (AR) is disclosed. At least two sensors and a display are mounted on the flexible frame. When in use, the real time geometry of the eyewear device may change from factory calibrated geometry, resulting in low quality AR rendering. A modeling module is provided to model the real time geometry of the eyewear device on the fly using sensor information of the at least two sensors. The modeled real time geometry is then provided to a rendering module to accurately display the AR to the user.
-
公开(公告)号:US11614618B2
公开(公告)日:2023-03-28
申请号:US17301657
申请日:2021-04-09
Applicant: Snap Inc.
Inventor: Jeffrey Michael DeWall , Dominik Schnitzer , Amit Singh , Daniel Wagner
Abstract: A method for configuring a digital light projector (DLP) of an augmented reality (AR) display device is described. A light source component of the DLP projector is configured to generate a single red-green-blue color sequence repetition per image frame. The AR display device identifies a color sequence of the light source component of the DLP projector and tracks a motion of the AR display device. The AR display device adjusts an operation of the DLP projector based on the single red-green-blue color sequence repetition, the color sequence of the light source component of the DLP projector, and the motion of the AR display device.
-
公开(公告)号:US20220377209A1
公开(公告)日:2022-11-24
申请号:US17746292
申请日:2022-05-17
Applicant: Snap Inc.
Inventor: Sagi Katz , Daniel Wagner , Weston Welge
Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for varied depth determination using stereo vision and phase detection auto focus (PDAF). Computer stereo vision (stereo vision) is used to extract three-dimensional information from digital images. To utilize stereo vision, two optical sensors are displaced horizontally from one another and used to capture images depicting two differing views of a real-world environment from two different vantage points. The relative depth of the objects captured in the images is determined using triangulation by comparing the relative positions of the objects in the two images. For example, the relative positions of matching objects (e.g., features) identified in the captured images are used along with the known orientation of the optical sensors (e.g., distance between the optical sensors, vantage points the optical sensors) to estimate the depth of the objects.
-
-
-
-
-