公开(公告)号：US20240153116A1

公开(公告)日：2024-05-09

申请号：US17981891

申请日：2022-11-07

Applicant: Google LLC

Inventor： Kuntal Sengupta ,  Adarsh Kowdle ,  Andrey Zhmoginov ,  Hart Levy

IPC: G06T7/521 ,  G06F21/32 ,  G06V40/16 ,  G06V40/40

CPC classification number: G06T7/521 ,  G06F21/32 ,  G06V40/172 ,  G06V40/40 ,  G06T2207/10048 ,  G06T2207/20081 ,  G06T2207/30201

Abstract: Provided are computing systems, methods, and platforms for using machine-learned models to generate a depth map. The operations can include projecting, using a dot illuminator, near-infrared (NIR) dots on the scene. The NIR dots can have a uniform pattern. Additionally, the operations can include capturing, using a single NIR camera, the projected NIR dots on the scene. Moreover, the operations can include generating a dot image based on the captured NIR dots on the scene. Furthermore, the operations can include processing the dot image with a machine-learned model to generate a depth map of the scene. Subsequently, the operations can further include evaluating the generated depth map of the scene and a ground truth depth map, and performing an action based on the evaluation.

公开(公告)号：US20250131534A1

公开(公告)日：2025-04-24

申请号：US18999529

申请日：2024-12-23

Applicant: Google LLC

Inventor： Changgeng Liu ,  Marek Mienko ,  Hart Levy ,  Ion Bita ,  Xi Chen

IPC: G06T5/50 ,  G06T5/20 ,  G06T5/60 ,  G06T7/70 ,  H04N23/56 ,  H04N23/90 ,  H04N23/95 ,  H04N25/40 ,  H04N25/532

Abstract: Systems and techniques directed at an electronic device with a centrally located under-display image sensor are disclosed. The electronic device includes a first image sensor and a second image sensor, the second image sensor being an under-display sensor located at substantially a center of a display of the electronic device. The first image sensor may be located adjacent to an edge of the display. The second image sensor is configured to capture an eye gaze of a user and provide the captured eye gaze to correct the eye gaze of images captured by the first image sensor. The first image sensor may also be an under-display image sensor. During video communications with the electronic device, a user usually looks at the center of the display of the electronic device. The second image sensor is configured to capture the correct eye gaze of the user during video communications.