公开(公告)号：US20240177419A1

公开(公告)日：2024-05-30

申请号：US18522763

申请日：2023-11-29

Applicant: Meta Platforms Technologies, LLC

Inventor： Shunsuke Saito ,  Junxuan Li ,  Tomas Simon Kreuz ,  Jason Saragih ,  Shun Iwase ,  Timur Bagautdinov ,  Rohan Joshi ,  Fabian Andres Prada Nino ,  Takaaki Shiratori ,  Yaser Sheikh ,  Stephen Anthony Lombardi

IPC: G06T17/10 ,  G06V10/40

CPC classification number: G06T17/10 ,  G06V10/40 ,  G06T2207/30201

Abstract: Methods, systems, and storage media for modeling subjects in a virtual environment are disclosed. Exemplary implementations may: receiving, from a client device, image data including at least one subject; extracting, from the image data, a face of the at least one subject and an object interacting with the face, wherein the object may be glasses worn by the subject; generating a set of face primitives based on the face, the set of face primitives comprising geometry and appearance information; generating a set of object primitives based on a set of latent codes for the object; generating an appearance model of photometric interactions between the face and the object; and rendering an avatar in the virtual environment based on the appearance model, the set of face primitives, and the set of object primitives.