公开(公告)号：US20230360182A1

公开(公告)日：2023-11-09

申请号：US18028930

申请日：2021-05-17

Applicant: Google LLC

Inventor： Sean Ryan Francesco Fanello ,  Yun-Ta Tsai ,  Rohit Kumar Pandey ,  Paul Debevec ,  Michael Milne ,  Chloe LeGendre ,  Jonathan Tilton Barron ,  Christoph Rhemann ,  Sofien Bouaziz ,  Navin Padman Sarma

IPC: G06T5/00 ,  G06T7/60 ,  G06T7/70 ,  G06T15/50

CPC classification number: G06T5/009 ,  G06T7/60 ,  G06T7/70 ,  G06T15/506 ,  G06T2200/24 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20092 ,  G06T2207/20208 ,  G06T2207/30201

Abstract: Apparatus and methods related to applying lighting models to images of objects are provided. An example method includes applying a geometry model to an input image to determine a surface orientation map indicative of a distribution of lighting on an object based on a surface geometry. The method further includes applying an environmental light estimation model to the input image to determine a direction of synthetic lighting to be applied to the input image. The method also includes applying, based on the surface orientation map and the direction of synthetic lighting, a light energy model to determine a quotient image indicative of an amount of light energy to be applied to each pixel of the input image. The method additionally includes enhancing, based on the quotient image, a portion of the input image. One or more neural networks can be trained to perform one or more of the aforementioned aspects.