Invention Grant
- Patent Title: Volumetric performance capture with relighting
-
Application No.: US17413847Application Date: 2020-11-11
-
Publication No.: US12066282B2Publication Date: 2024-08-20
- Inventor: Sean Ryan Francesco Fanello , Kaiwen Guo , Peter Christopher Lincoln , Philip Lindsley Davidson , Jessica L. Busch , Xueming Yu , Geoffrey Harvey , Sergio Orts Escolano , Rohit Kumar Pandey , Jason Dourgarian , Danhang Tang , Adarsh Prakash Murthy Kowdle , Emily B. Cooper , Mingsong Dou , Graham Fyffe , Christoph Rhemann , Jonathan James Taylor , Shahram Izadi , Paul Ernest Debevec
- Applicant: GOOGLE LLC
- Applicant Address: US CA Mountain View
- Assignee: GOOGLE LLC
- Current Assignee: GOOGLE LLC
- Current Assignee Address: US CA Mountain View
- International Application: PCT/US2020/059973 2020.11.11
- International Announcement: WO2021/096930A 2021.05.20
- Date entered country: 2021-06-14
- Main IPC: G01B11/25
- IPC: G01B11/25 ; G01B11/245 ; G06T15/50 ; G06T17/20

Abstract:
A lighting stage includes a plurality of lights that project alternating spherical color gradient illumination patterns onto an object or human performer at a predetermined frequency. The lighting stage also includes a plurality of cameras that capture images of an object or human performer corresponding to the alternating spherical color gradient illumination patterns. The lighting stage also includes a plurality of depth sensors that capture depth maps of the object or human performer at the predetermined frequency. The lighting stage also includes (or is associated with) one or more processors that implement a machine learning algorithm to produce a three-dimensional (3D) model of the object or human performer. The 3D model includes relighting parameters used to relight the 3D model under different lighting conditions.
Public/Granted literature
- US20220065620A1 VOLUMETRIC PERFORMANCE CAPTURE WITH RELIGHTING Public/Granted day:2022-03-03
Information query