公开(公告)号：US11978225B2

公开(公告)日：2024-05-07

申请号：US18135678

申请日：2023-04-17

Applicant: Google LLC

Inventor： Tali Dekel ,  Forrester Cole ,  Ce Liu ,  William Freeman ,  Richard Tucker ,  Noah Snavely ,  Zhengqi Li

IPC: G06T7/579 ,  G06T7/246 ,  G06T7/73

CPC classification number: G06T7/579 ,  G06T7/246 ,  G06T7/73 ,  G06T2207/10016 ,  G06T2207/10028 ,  G06T2207/20081 ,  G06T2207/30244

Abstract: A method includes obtaining a reference image and a target image each representing an environment containing moving features and static features. The method also includes determining an object mask configured to mask out the moving features and preserves the static features in the target image. The method additionally includes determining, based on motion parallax between the reference image and the target image, a static depth image representing depth values of the static features in the target image. The method further includes generating, by way of a machine learning model, a dynamic depth image representing depth values of both the static features and the moving features in the target image. The model is trained to generate the dynamic depth image by determining depth values of at least the moving features based on the target image, the object mask, and the static depth image.

公开(公告)号：US20210090279A1

公开(公告)日：2021-03-25

申请号：US16578215

申请日：2019-09-20

Applicant: Google LLC

Inventor： Tali Dekel ,  Forrester Cole ,  Ce Liu ,  William Freeman ,  Richard Tucker ,  Noah Snavely ,  Zhengqi Li

IPC: G06T7/579 ,  G06T7/246 ,  G06T7/73

Abstract: A method includes obtaining a reference image and a target image each representing an environment containing moving features and static features. The method also includes determining an object mask configured to mask out the moving features and preserves the static features in the target image. The method additionally includes determining, based on motion parallax between the reference image and the target image, a static depth image representing depth values of the static features in the target image. The method further includes generating, by way of a machine learning model, a dynamic depth image representing depth values of both the static features and the moving features in the target image. The model is trained to generate the dynamic depth image by determining depth values of at least the moving features based on the target image, the object mask, and the static depth image.

公开(公告)号：US20250157133A1

公开(公告)日：2025-05-15

申请号：US18515024

申请日：2023-11-20

Applicant: Google LLC

Inventor： Keith Noah Snavely ,  Zhengqi Li ,  Forrester H. Cole ,  Richard Tucker ,  Qianqian Wang

IPC: G06T15/20 ,  G06T7/215 ,  G06T11/00 ,  G06T15/06 ,  G06V10/44 ,  G06V10/56 ,  H04N13/117

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for rendering a new image that depicts a scene from a perspective of a camera at a new camera viewpoint at a given time point in a video.

公开(公告)号：US20230260145A1

公开(公告)日：2023-08-17

申请号：US18135678

申请日：2023-04-17

Applicant: Google LLC

Inventor： Tali Dekel ,  Forrester Cole ,  Ce Liu ,  William Freeman ,  Richard Tucker ,  Noah Snavely ,  Zhengqi Li

IPC: G06T7/579 ,  G06T7/246 ,  G06T7/73

CPC classification number: G06T7/579 ,  G06T7/246 ,  G06T7/73 ,  G06T2207/10016 ,  G06T2207/30244 ,  G06T2207/20081 ,  G06T2207/10028

Abstract: A method includes obtaining a reference image and a target image each representing an environment containing moving features and static features. The method also includes determining an object mask configured to mask out the moving features and preserves the static features in the target image. The method additionally includes determining, based on motion parallax between the reference image and the target image, a static depth image representing depth values of the static features in the target image. The method further includes generating, by way of a machine learning model, a dynamic depth image representing depth values of both the static features and the moving features in the target image. The model is trained to generate the dynamic depth image by determining depth values of at least the moving features based on the target image, the object mask, and the static depth image.

公开(公告)号：US11663733B2

公开(公告)日：2023-05-30

申请号：US17656165

申请日：2022-03-23

Applicant: Google LLC

Inventor： Tali Dekel ,  Forrester Cole ,  Ce Liu ,  William Freeman ,  Richard Tucker ,  Noah Snavely ,  Zhengqi Li

IPC: G06T7/579 ,  G06T7/246 ,  G06T7/73

CPC classification number: G06T7/579 ,  G06T7/246 ,  G06T7/73 ,  G06T2207/10016 ,  G06T2207/10028 ,  G06T2207/20081 ,  G06T2207/30244

Abstract: A method includes obtaining a reference image and a target image each representing an environment containing moving features and static features. The method also includes determining an object mask configured to mask out the moving features and preserves the static features in the target image. The method additionally includes determining, based on motion parallax between the reference image and the target image, a static depth image representing depth values of the static features in the target image. The method further includes generating, by way of a machine learning model, a dynamic depth image representing depth values of both the static features and the moving features in the target image. The model is trained to generate the dynamic depth image by determining depth values of at least the moving features based on the target image, the object mask, and the static depth image.

公开(公告)号：US20220215568A1

公开(公告)日：2022-07-07

申请号：US17656165

申请日：2022-03-23

Applicant: Google LLC

Inventor： Tali Dekel ,  Forrester Cole ,  Ce Liu ,  William Freeman ,  Richard Tucker ,  Noah Snavely ,  Zhengqi Li

IPC: G06T7/579 ,  G06T7/246 ,  G06T7/73

Abstract: A method includes obtaining a reference image and a target image each representing an environment containing moving features and static features. The method also includes determining an object mask configured to mask out the moving features and preserves the static features in the target image. The method additionally includes determining, based on motion parallax between the reference image and the target image, a static depth image representing depth values of the static features in the target image. The method further includes generating, by way of a machine learning model, a dynamic depth image representing depth values of both the static features and the moving features in the target image. The model is trained to generate the dynamic depth image by determining depth values of at least the moving features based on the target image, the object mask, and the static depth image.

公开(公告)号：US11315274B2

公开(公告)日：2022-04-26

申请号：US16578215

申请日：2019-09-20

Applicant: Google LLC

Inventor： Tali Dekel ,  Forrester Cole ,  Ce Liu ,  William Freeman ,  Richard Tucker ,  Noah Snavely ,  Zhengqi Li

IPC: G06T7/00 ,  G06T7/579 ,  G06T7/246 ,  G06T7/73

Abstract: A method includes obtaining a reference image and a target image each representing an environment containing moving features and static features. The method also includes determining an object mask configured to mask out the moving features and preserves the static features in the target image. The method additionally includes determining, based on motion parallax between the reference image and the target image, a static depth image representing depth values of the static features in the target image. The method further includes generating, by way of a machine learning model, a dynamic depth image representing depth values of both the static features and the moving features in the target image. The model is trained to generate the dynamic depth image by determining depth values of at least the moving features based on the target image, the object mask, and the static depth image.