Invention Grant
- Patent Title: Systems and methods for rendering avatar using uncorrelated codec portions in codec
-
Application No.: US16852226Application Date: 2020-04-17
-
Publication No.: US11182947B1Publication Date: 2021-11-23
- Inventor: Chenglei Wu , Jason Saragih , Tomas Simon Kreuz , Takaaki Shiratori
- Applicant: Facebook Technologies, LLC
- Applicant Address: US CA Menlo Park
- Assignee: Facebook Technologies, LLC
- Current Assignee: Facebook Technologies, LLC
- Current Assignee Address: US CA Menlo Park
- Agency: Baker Botts L.L.P.
- Main IPC: G06T13/40
- IPC: G06T13/40 ; G06N20/00 ; G06T17/20

Abstract:
In one embodiment, a system may access a codec that encodes an appearance associated with a subject and comprise codec portions that respectively correspond to body parts of the subject. The system may generate a training codec that comprises a first subset of the codec portions (a first set of body parts) and a modified second subset of the codec portions (muted body parts). The system may decode the training codec using a machine-learning model to generate a mesh of the subject. The system may transform the mesh of the subject based on a predetermined pose. The system may update the machine-learning model based on a comparison between the transformed mesh and a target mesh of the subject having the predetermined pose. The system in the present application can train a machine-learning model to render an avatar with a pose using uncorrelated codec portions corresponding to different body parts.
Information query