公开(公告)号：US12211138B2

公开(公告)日：2025-01-28

申请号：US18065456

申请日：2022-12-13

Applicant: Adobe Inc.

Inventor： Zhengfei Kuang ,  Fujun Luan ,  Sai Bi ,  Zhixin Shu ,  Kalyan K. Sunkavalli

IPC: G06T15/08 ,  G06T15/06 ,  G06T15/50 ,  G06T15/80 ,  G06T19/20

Abstract: Embodiments of the present disclosure provide systems, methods, and computer storage media for generating editable synthesized views of scenes by inputting image rays into neural networks using neural basis decomposition. In embodiments, a set of input images of a scene depicting at least one object are collected and used to generate a plurality of rays of the scene. The rays each correspond to three-dimensional coordinates and viewing angles taken from the images. A volume density of the scene is determined by inputting the three-dimensional coordinates from the neural radiance fields into a first neural network to generate a 3D geometric representation of the object. An appearance decomposition is produced by inputting the three-dimensional coordinates and the viewing angles of the rays into a second neural network.

公开(公告)号：US20240193850A1

公开(公告)日：2024-06-13

申请号：US18065456

申请日：2022-12-13

Applicant: Adobe Inc.

Inventor： Zhengfei Kuang ,  Fujun Luan ,  Sai Bi ,  Zhixin Shu ,  Kalyan K. Sunkavalli

IPC: G06T15/08 ,  G06T15/06 ,  G06T15/50 ,  G06T15/80 ,  G06T19/20

CPC classification number: G06T15/08 ,  G06T15/06 ,  G06T15/503 ,  G06T15/80 ,  G06T19/20 ,  G06T2219/2012

Abstract: Embodiments of the present disclosure provide systems, methods, and computer storage media for generating editable synthesized views of scenes by inputting image rays into neural networks using neural basis decomposition. In embodiments, a set of input images of a scene depicting at least one object are collected and used to generate a plurality of rays of the scene. The rays each correspond to three-dimensional coordinates and viewing angles taken from the images. A volume density of the scene is determined by inputting the three-dimensional coordinates from the neural radiance fields into a first neural network to generate a 3D geometric representation of the object. An appearance decomposition is produced by inputting the three-dimensional coordinates and the viewing angles of the rays into a second neural network.