公开(公告)号：US20220343525A1

公开(公告)日：2022-10-27

申请号：US17640114

申请日：2020-04-27

Applicant: GOOGLE LLC

Inventor： Rahul GARG ,  Neal WADHWA ,  Sean FANELLO ,  Christian HAENE ,  Yinda ZHANG ,  Sergio Orts ESCOLANO ,  Yael Pritch KNAAN ,  Marc LEVOY ,  Shahram IZADI

IPC: G06T7/593 ,  G06T5/00

Abstract: Example implementations relate to joint depth prediction from dual cameras and dual pixels. An example method may involve obtaining a first set of depth information representing a scene from a first source and a second set of depth information representing the scene from a second source. The method may further involve determining, using a neural network, a joint depth map that conveys respective depths for elements in the scene. The neural network may determine the joint depth map based on a combination of the first set of depth information and the second set of depth information. In addition, the method may involve modifying an image representing the scene based on the joint depth map. For example, background portions of the image may be partially blurred based on the joint depth map.

公开(公告)号：US20230325985A1

公开(公告)日：2023-10-12

申请号：US18022396

申请日：2021-10-14

Applicant: GOOGLE LLC

Inventor： Soo Ye KIM ,  Orly LIBA ,  Rahul GARG ,  Nori KANAZAWA ,  Neal WADHWA ,  Kfir ABERMAN ,  Huiwen CHANG

IPC: G06T5/00 ,  G06T5/50 ,  G06T3/40

CPC classification number: G06T5/005 ,  G06T5/50 ,  G06T3/4046 ,  G06T2207/20016

Abstract: A method includes receiving an input image. The input image corresponds to one or more masked regions to be inpainted. The method includes providing the input image to a first neural network. The first neural network outputs a first inpainted image at a first resolution, and the one or more masked regions are inpainted in the first inpainted image. The method includes creating a second inpainted image by increasing a resolution of the first inpainted image from the first resolution to a second resolution. The second resolution is greater than the first resolution such that the one or more inpainted masked regions have an increased resolution. The method includes providing the second inpainted image to a second neural network. The second neural network outputs a first refined inpainted image at the second resolution, and the first refined inpainted image is a refined version of the second inpainted image.