公开(公告)号：US12094054B2

公开(公告)日：2024-09-17

申请号：US17639967

申请日：2020-05-04

Applicant: GOOGLE LLC

Inventor： Yun-Ta Tsai ,  Xiuming Zhang ,  Jonathan T. Barron ,  Sean Fanello ,  Tiancheng Sun ,  Tianfan Xue

IPC: G06T15/50 ,  G06N3/084 ,  G06T15/04 ,  G06T15/20

CPC classification number: G06T15/506 ,  G06N3/084 ,  G06T15/04 ,  G06T15/205 ,  G06T2200/04 ,  G06T2200/08 ,  G06T2200/24

Abstract: Examples relate to implementations of a neural light transport. A computing system may obtain data indicative of a plurality of UV texture maps and a geometry of an object. Each UV texture map depicts the object from a perspective of a plurality of perspectives. The computing system may train a neural network to learn a light transport function using the data. The light transport function may be a continuous function that specifies how light interacts with the object when the object is viewed from the plurality of perspectives. The computing system may generate an output UV texture map that depicts the object from a synthesized perspective based on an application of the light transport function by the trained neural network.

公开(公告)号：US12136203B2

公开(公告)日：2024-11-05

申请号：US18236583

申请日：2023-08-22

Applicant: Google LLC

Inventor： Tiancheng Sun ,  Yun-Ta Tsai ,  Jonathan Barron

IPC: G06T5/00 ,  G06T5/94 ,  G06T15/50

Abstract: Apparatus and methods related to applying lighting models to images of objects are provided. A neural network can be trained to apply a lighting model to an input image. The training of the neural network can utilize confidence learning that is based on light predictions and prediction confidence values associated with lighting of the input image. A computing device can receive an input image of an object and data about a particular lighting model to be applied to the input image. The computing device can determine an output image of the object by using the trained neural network to apply the particular lighting model to the input image of the object.

公开(公告)号：US20230401681A1

公开(公告)日：2023-12-14

申请号：US18236583

申请日：2023-08-22

Applicant: Google LLC

Inventor： Tiancheng Sun ,  Yun-Ta Tsai ,  Jonathan Barron

IPC: G06T5/00

CPC classification number: G06T5/008 ,  G06T15/506

Abstract: Apparatus and methods related to applying lighting models to images of objects are provided. A neural network can be trained to apply a lighting model to an input image. The training of the neural network can utilize confidence learning that is based on light predictions and prediction confidence values associated with lighting of the input image. A computing device can receive an input image of an object and data about a particular lighting model to be applied to the input image. The computing device can determine an output image of the object by using the trained neural network to apply the particular lighting model to the input image of the object.

公开(公告)号：US11776095B2

公开(公告)日：2023-10-03

申请号：US17260364

申请日：2019-04-01

Applicant: GOOGLE LLC

Inventor： Tiancheng Sun ,  Yun-ta Tsai ,  Jonathan Barron

IPC: G06T5/00 ,  G06T15/50

CPC classification number: G06T5/008 ,  G06T15/506 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: Apparatus and methods related to applying lighting models to images of objects are provided. A neural network can be trained to apply a lighting model to an input image. The training of the neural network can utilize confidence learning that is based on light predictions and prediction confidence values associated with lighting of the input image. A computing device can receive an input image of an object and data about a particular lighting model to be applied to the input image. The computing device can determine an output image of the object by using the trained neural network to apply the particular lighting model to the input image of the object.