公开(公告)号：US20220065620A1

公开(公告)日：2022-03-03

申请号：US17413847

申请日：2020-11-11

Applicant: GOOGLE LLC

Inventor： Sean Ryan Francesco Fanello ,  Kaiwen Guo ,  Peter Christopher Lincoln ,  Philip Lindsley Davidson ,  Jessica L. Busch ,  Xueming Yu ,  Geoffrey Harvey ,  Sergio Orts Escolano ,  Rohit Kumar Pandey ,  Jason Dourgarian ,  Danhang Tang ,  Adarsh Prakash Murthy Kowdle ,  Emily B. Cooper ,  Mingsong Dou ,  Graham Fyffe ,  Christoph Rhemann ,  Jonathan James Taylor ,  Shahram Izadi ,  Paul Ernest Debevec

IPC: G01B11/25 ,  G06T15/50 ,  G01B11/245 ,  G06T17/20

Abstract: A lighting stage includes a plurality of lights that project alternating spherical color gradient illumination patterns onto an object or human performer at a predetermined frequency. The lighting stage also includes a plurality of cameras that capture images of an object or human performer corresponding to the alternating spherical color gradient illumination patterns. The lighting stage also includes a plurality of depth sensors that capture depth maps of the object or human performer at the predetermined frequency. The lighting stage also includes (or is associated with) one or more processors that implement a machine learning algorithm to produce a three-dimensional (3D) model of the object or human performer. The 3D model includes relighting parameters used to relight the 3D model under different lighting conditions.

公开(公告)号：US10937182B2

公开(公告)日：2021-03-02

申请号：US15994471

申请日：2018-05-31

Applicant: Google LLC

Inventor： Mingsong Dou ,  Sean Ryan Fanello ,  Adarsh Prakash Murthy Kowdle ,  Christoph Rhemann ,  Sameh Khamis ,  Philip L. Davidson ,  Shahram Izadi ,  Vladimir Tankovich

IPC: G06T7/593 ,  G06T7/73 ,  G06T15/08 ,  G06T17/20

Abstract: An electronic device estimates a pose of one or more subjects in an environment based on estimating a correspondence between a data volume containing a data mesh based on a current frame captured by a depth camera and a reference volume containing a plurality of fused prior data frames based on spectral embedding and performing bidirectional non-rigid matching between the reference volume and the current data frame to refine the correspondence so as to support location-based functionality. The electronic device predicts correspondences between the data volume and the reference volume based on spectral embedding. The correspondences provide constraints that accelerate the convergence between the data volume and the reference volume. By tracking changes between the current data mesh frame and the reference volume, the electronic device avoids tracking failures that can occur when relying solely on a previous data mesh frame.