公开(公告)号：US20240223715A1

公开(公告)日：2024-07-04

申请号：US18606150

申请日：2024-03-15

Applicant: Snap Inc.

Inventor： Sagi Katz ,  Daniel Wagner ,  Weston Welge

IPC: H04N5/222 ,  H04N23/45 ,  H04N23/67

CPC classification number: H04N5/2226 ,  H04N23/45 ,  H04N23/672

Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for varied depth determination using stereo vision and phase detection auto focus (PDAF). Computer stereo vision (stereo vision) is used to extract three-dimensional information from digital images. To utilize stereo vison, two optical sensors are displaced horizontally from one another and used to capture images depicting two differing views of a real-world environment from two different vantage points. The relative depth of the objects captured in the images is determined using triangulation by comparing the relative positions of the objects in the two images. For example, the relative positions of matching objects (e.g., features) identified in the captured images are used along with the known orientation of the optical sensors (e.g., distance between the optical sensors, vantage points the optical sensors) to estimate the depth of the objects.

公开(公告)号：US20240103631A1

公开(公告)日：2024-03-28

申请号：US18357607

申请日：2023-07-24

Applicant: Snap Inc.

Inventor： Daniel Colascione ,  Patrick Timothy McSweeney Simons ,  Weston Welge ,  Ramzi Zahreddine

IPC: G06F3/01 ,  G02B27/01 ,  G06T19/00

CPC classification number: G06F3/017 ,  G02B27/017 ,  G06F3/011 ,  G06T19/006 ,  G02B2027/0138 ,  G02B2027/0178

Abstract: A system for hand tracking for an Augmented Reality (AR) system. The AR system uses a camera of the AR system to capture tracking video frame data of a hand of a user of the AR system. The AR system generates a skeletal model based on the tracking video frame data and determines a location of the hand of the user based on the skeletal model. The AR system causes a steerable camera of the AR system to focus on the hand of the user.

公开(公告)号：US11722630B2

公开(公告)日：2023-08-08

申请号：US17746292

申请日：2022-05-17

Applicant: Snap Inc.

Inventor： Sagi Katz ,  Daniel Wagner ,  Weston Welge

IPC: H04N5/222 ,  H04N23/45 ,  H04N23/67

CPC classification number: H04N5/2226 ,  H04N23/45 ,  H04N23/672

Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for varied depth determination using stereo vision and phase detection auto focus (PDAF). Computer stereo vision (stereo vision) is used to extract three-dimensional information from digital images. To utilize stereo vision, two optical sensors are displaced horizontally from one another and used to capture images depicting two differing views of a real-world environment from two different vantage points. The relative depth of the objects captured in the images is determined using triangulation by comparing the relative positions of the objects in the two images. For example, the relative positions of matching objects (e.g., features) identified in the captured images are used along with the known orientation of the optical sensors (e.g., distance between the optical sensors, vantage points the optical sensors) to estimate the depth of the objects.