公开(公告)号：US20230319424A1

公开(公告)日：2023-10-05

申请号：US18246609

申请日：2021-11-09

Applicant: Google LLC

Inventor： Jason Lawrence ,  Supreeth Achar ,  Zhihao Xia

IPC: H04N23/84 ,  H04N23/11 ,  H04N23/56 ,  G06T5/00

CPC classification number: H04N23/84 ,  H04N23/11 ,  H04N23/56 ,  G06T5/002 ,  G06T2207/10024 ,  G06T2207/10048 ,  G06T2207/20084 ,  G06T2207/20081 ,  G06T2207/10012

Abstract: Techniques of estimating surface normals and reflectance from poorly-lit images includes using, in addition to an RGB image of a subject of a set of subjects, an image illuminated with near-infrared (NIR) radiation to determine albedo and surface normal maps for performing an image relighting, the image being captured with the NIR radiation from essentially the same perspective from which the RGB image was captured. In some implementations, a prediction engine takes as input a single RGB image and a single NIR image and estimates surface normals and reflectance from the subject.

公开(公告)号：US20230088801A1

公开(公告)日：2023-03-23

申请号：US17754626

申请日：2021-04-08

Applicant: GOOGLE LLC

Inventor： Jason Lawrence ,  Supreeth Achar ,  Zhihao Xia

IPC: H04N23/72 ,  H04N23/74 ,  H04N23/76 ,  H04N9/64 ,  G06T5/50

Abstract: An imaging system includes a processor, a memory, a visible light camera configured to record a first image of a scene, and an infrared camera configured to record a second image of the scene. The processor configured to execute instructions stored in the memory to input the first image and the second image into a neural network. The neural network relights the first image, based on characteristics of the second image, to correspond to an image of the scene under canonical illumination conditions.