公开(公告)号：US20230396751A1

公开(公告)日：2023-12-07

申请号：US18250059

申请日：2020-10-23

Applicant: Google LLC

Inventor： Hugues Herve Hoppe ,  Ricardo Martin Brualla ,  Harris Nover

IPC: H04N13/128 ,  H04N13/111

CPC classification number: H04N13/128 ,  H04N13/111

Abstract: Systems and methods are described for utilizing an image processing system with at least one processing device to perform operations including receiving a plurality of depth views of an object, each of the plurality of depth views being captured from a respective viewpoint of the object, each of the plurality of depth views including respective depth data associated with a depth image of the object captured from the respective viewpoint, performing an aggregation operation on the plurality of depth views, and generating an image of the object from a target viewpoint based on the updated depth views, the target viewpoint being different from each of the respective viewpoints from which each of the plurality of depth views are captured.

公开(公告)号：US20240153121A1

公开(公告)日：2024-05-09

申请号：US18548779

申请日：2021-03-03

Applicant: Google LLC

Inventor： Harris Nover ,  Supreeth Achar ,  Kira Prabhu ,  Vineet Bhatawadekar

IPC: G06T7/593 ,  G06T5/20 ,  G06V10/75

CPC classification number: G06T7/593 ,  G06T5/20 ,  G06V10/751 ,  G06T2207/10012 ,  G06T2207/20228

Abstract: According to an aspect, a real-time active stereo system includes a capture system configured to capture stereo image data, the stereo image data including reference images and secondary images, and a depth sensing computing system configured to generate a depth map, the depth sensing computing system configured to compute descriptors based on the reference images and the secondary images compute a stability penalty based on pixel change information and disparity change information. evaluate a plurality of plane hypotheses for a group of pixels using the descriptors, including compute matching cost between the descriptors associated with each plane hypothesis, update the matching cost with the stability penalty, and select a plane hypothesis from the plurality of plane hypotheses for the group of pixels based on the updated matching cost.

公开(公告)号：US11190746B2

公开(公告)日：2021-11-30

申请号：US16710655

申请日：2019-12-11

Applicant: GOOGLE LLC

Inventor： Daniel Goldman ,  Harris Nover ,  Supreeth Achar

IPC: H04N13/106 ,  H04N13/254 ,  G06T7/593 ,  G06T7/11 ,  G06T5/00 ,  G06T7/174 ,  H04N13/00

Abstract: According to an aspect, a real-time active stereo system includes a capture system configured to capture stereo image data, where the image data includes a plurality of pairs of a reference image and a secondary image, and each pair of the plurality of pairs relates a different temporal window. The real-time active stereo system includes a depth sensing computing system including at least one processor and a non-transitory computer-readable medium having executable instructions that when executed by the at least one processor are configured to execute a local stereo reconstruction algorithm configured to compute spacetime descriptors from the plurality of pairs of the stereo image data and generate depth maps based on the spacetime descriptors.

公开(公告)号：US10818071B1

公开(公告)日：2020-10-27

申请号：US16523702

申请日：2019-07-26

Applicant: Google LLC

Inventor： Hugues Hoppe ,  Ricardo Martin Brualla ,  Harris Nover

IPC: G06T15/06 ,  G06T7/70 ,  G06T7/55 ,  G06T15/20 ,  H04N13/111

Abstract: Techniques of rendering images includes generating signed distance values (SDVs) along a ray from a specified viewpoint in terms of projected distances along that ray from given depth images. For each pixel in an image of from the perspective of the specified viewpoint, a ray is traced into the three-dimensional scene represented by the image. An iterative step is performed along the ray, obtaining in each iteration a three-dimensional world-space point p. The result is the signed distance sj as measured from depth view Dj. If the absolute value of the signed distance sj is greater than some truncation threshold parameter, the signed distance sj is replaced by a special undefined value. The defined signed-distance values are aggregated to obtain an overall signed distance s. Finally, the roots or zero set (isosurface) of the signed distance field is determined.