Invention Application
- Patent Title: NEURAL BLENDING FOR NOVEL VIEW SYNTHESIS
-
Application No.: US17754392Application Date: 2021-04-08
-
Publication No.: US20220398705A1Publication Date: 2022-12-15
- Inventor: Ricardo Martin Brualla , Daniel Goldman , Hugues Herve Hoppe , Lynn Tsai , Lars Peter Johannes Hedman
- Applicant: GOOGLE LLC
- Applicant Address: US CA Mountain View
- Assignee: GOOGLE LLC
- Current Assignee: GOOGLE LLC
- Current Assignee Address: US CA Mountain View
- International Application: PCT/US2021/070362 WO 20210408
- Main IPC: G06T5/50
- IPC: G06T5/50 ; G06T3/00 ; G06T5/00 ; G06T15/20 ; G06T7/55

Abstract:
Systems and methods are described for receiving a plurality of input images, a plurality of depth images, and a plurality of view parameters for generating a virtual view of a target subject. The systems and methods may generate a plurality of warped images based on the plurality of input images, the plurality of view parameters, and at least one of the plurality of depth images. In response to providing the plurality of depth images, the plurality of view parameters, and the plurality of warped images to a neural network, the systems and methods may receive, from the neural network, blending weights for assigning color to pixels of the virtual view of the target subject and may generate, based on the blending weights and the virtual view, a synthesized image according to the view parameters.
Information query