公开(公告)号：US11087521B1

公开(公告)日：2021-08-10

申请号：US16775953

申请日：2020-01-29

Applicant: Facebook Technologies, LLC

Inventor： Stephen Anthony Lombardi ,  Jason Saragih ,  Yaser Sheikh ,  Takaaki Shiratori ,  Shoou-I Yu ,  Tomas Simon Kreuz ,  Chenglei Wu

IPC: G06T13/40 ,  G06T17/20 ,  G06T15/04 ,  G06T15/20 ,  G06T15/06 ,  G06T19/00

Abstract: The disclosed computer system may include an input module, an autoencoder, and a rendering module. The input module may receive geometry information and images of a subject. The geometry information may be indicative of variation in geometry of the subject over time. Each image may be associated with a respective viewpoint and may include a view-dependent texture map of the subject. The autoencoder may jointly encode texture information and the geometry information to provide a latent vector. The autoencoder may infer, using the latent vector, an inferred geometry and an inferred view-dependent texture of the subject for a predicted viewpoint. The rendering module may be configured to render a reconstructed image of the subject for the predicted viewpoint using the inferred geometry and the inferred view-dependent texture. Various other systems and methods are also disclosed.