公开(公告)号：US11989846B2

公开(公告)日：2024-05-21

申请号：US17554992

申请日：2021-12-17

Applicant: Meta Platforms Technologies, LLC

Inventor： Stephen Anthony Lombardi ,  Tomas Simon Kreuz ,  Jason Saragih ,  Gabriel Bailowitz Schwartz ,  Michael Zollhoefer ,  Yaser Sheikh

IPC: G06T19/20 ,  G06T15/06 ,  G06T17/20

CPC classification number: G06T19/20 ,  G06T15/06 ,  G06T17/20 ,  G06T2219/2012

Abstract: A method for training a real-time, modeling for animating an avatar for a subject is provided. The method includes collecting multiple images of a subject. The method also includes selecting a plurality of vertex positions in a guide mesh, indicative of a volumetric primitive enveloping the subject, determining a geometric attribute for the volumetric primitive including a position, a rotation, and a scale factor of the volumetric primitive, determining a payload attribute for each of the volumetric primitive, the payload attribute including a color value and an opacity value for each voxel in a voxel grid defining the volumetric primitive, determining a loss factor for each point in the volumetric primitive based on the geometric attribute, the payload attribute and a ground truth value, and updating a three-dimensional model for the subject. A system and a non-transitory, computer-readable medium storing instructions to perform the above method are also provided.