公开(公告)号：US20220327769A1

公开(公告)日：2022-10-13

申请号：US17639967

申请日：2020-05-04

Applicant: GOOGLE LLC

Inventor： Yun-Ta TSAI ,  Xiuming ZHANG ,  Jonathan T. BARRON ,  Sean FANELLO ,  Tiancheng SUN ,  Tianfan XUE

IPC: G06T15/50 ,  G06T15/04 ,  G06T15/20 ,  G06N3/08

Abstract: Examples relate to implementations of a neural light transport. A computing system may obtain data indicative of a plurality of UV texture maps and a geometry of an object. Each UV texture map depicts the object from a perspective of a plurality of perspectives. The computing system may train a neural network to learn a light transport function using the data. The light transport function may be a continuous function that specifies how light interacts with the object when the object is viewed from the plurality of perspectives. The computing system may generate an output UV texture map that depicts the object from a synthesized perspective based on an application of the light transport function by the trained neural network.

公开(公告)号：US20210004979A1

公开(公告)日：2021-01-07

申请号：US16767401

申请日：2019-10-04

Applicant: Google LLC

Inventor： Jullien VALENTIN ,  Onur G. GULERYUZ ,  Mira LEUNG ,  Maksym DZITSIUK ,  Jose PASCOAL ,  Mirko SCHMIDT ,  Christoph RHEMANN ,  Neal WADHWA ,  Eric TURNER ,  Sameh KHAMIS ,  Adarsh Prakash Murthy KOWDLE ,  Ambrus CSASZAR ,  João Manuel Castro AFONSO ,  Jonathan T. BARRON ,  Michael SCHOENBERG ,  Ivan DRYANOVSKI ,  Vivek VERMA ,  Vladimir TANKOVICH ,  Shahram IZADI ,  Sean Ryan Francesco FANELLO ,  Konstantine Nicholas John TSOTSOS

IPC: G06T7/579 ,  G06T19/00

Abstract: A handheld user device includes a monocular camera to capture a feed of images of a local scene and a processor to select, from the feed, a keyframe and perform, for a first image from the feed, stereo matching using the first image, the keyframe, and a relative pose based on a pose associated with the first image and a pose associated with the keyframe to generate a sparse disparity map representing disparities between the first image and the keyframe. The processor further is to determine a dense depth map from the disparity map using a bilateral solver algorithm, and process a viewfinder image generated from a second image of the feed with occlusion rendering based on the depth map to incorporate one or more virtual objects into the viewfinder image to generate an AR viewfinder image. Further, the processor is to provide the AR viewfinder image for display.