Invention Grant
- Patent Title: Free-viewpoint photorealistic view synthesis from casually captured video
-
Application No.: US16574652Application Date: 2019-09-18
-
Publication No.: US10893250B2Publication Date: 2021-01-12
- Inventor: Abhishek Kar , Rodrigo Ortiz Cayon , Ben Mildenhall , Stefan Johannes Josef Holzer , Radu Bogdan Rusu
- Applicant: Fyusion, Inc.
- Applicant Address: US CA San Francisco
- Assignee: Fyusion, Inc.
- Current Assignee: Fyusion, Inc.
- Current Assignee Address: US CA San Francisco
- Agency: Kwan & Olynick LLP
- Main IPC: G09G5/00
- IPC: G09G5/00 ; H04N13/111 ; G06T7/557 ; H04N13/271 ; G06T7/579 ; G06T7/70 ; G06T7/514 ; G06T15/20 ; G06T7/00 ; G06T15/00 ; G06T15/50 ; G06T7/50 ; H04N5/232 ; G06T15/08 ; H04N13/00

Abstract:
A respective target viewpoint may be rendered for each of a plurality of multiplane images of a three-dimensional scene. Each of the multiplane images may be associated with a respective single plane image of the three-dimensional scene captured from a respective viewpoint. Each of the multiplane images may include a respective plurality of depth planes. Each of the depth planes may include a respective plurality of pixels from the respective single plane image. Each of the pixels in the depth plane may be positioned at approximately the same distance from the respective viewpoint. A weighted combination of the target viewpoint renderings may be determined, where the sampling density of the single plane images is sufficiently high that the weighted combination satisfies the inequality in Equation (7). The weighted combination of the target viewpoint renderings may be transmitted as a novel viewpoint image.
Public/Granted literature
- US20200226816A1 FREE-VIEWPOINT PHOTOREALISTIC VIEW SYNTHESIS FROM CASUALLY CAPTURED VIDEO Public/Granted day:2020-07-16
Information query