公开(公告)号：US11869150B1

公开(公告)日：2024-01-09

申请号：US17082948

申请日：2020-10-28

Applicant: Apple Inc.

Inventor： Andrew P. Mason

IPC: G06T17/20 ,  G06N5/046 ,  G06T19/20 ,  G06T15/04 ,  G06V40/16

CPC classification number: G06T17/20 ,  G06N5/046 ,  G06T15/04 ,  G06T19/20 ,  G06V40/175 ,  G06V40/176 ,  G06T2207/20081

Abstract: Techniques are disclosed for providing an avatar personalized for a specific person based on known data from a relatively large population of individuals and a relatively small data sample of the specific person. Auto-encoder neural networks are used in a novel manner to capture latent-variable representations of facial models. Once such models are developed, a very limited data sample of a specific person may be used in combination with convolutional-neural-networks or statistical filters, and driven by audio/visual input during real-time operations, to generate a realistic avatar of the specific individual's face. In some embodiments, conditional variables may be encoded (e.g. gender, age, body-mass-index, ethnicity, emotional state). In other embodiments, different portions of a face may be modeled separately and combined at run-time (e.g., face, tongue and lips). Models in accordance with this disclosure may be used to generate resolution independent output.

公开(公告)号：US20240221296A1

公开(公告)日：2024-07-04

申请号：US18609609

申请日：2024-03-19

Applicant: Apple Inc.

Inventor： Andrew P. Mason ,  Olivier Soares ,  Haarm-Pieter Duiker ,  John S. McCarten

IPC: G06T15/80 ,  G06T7/507 ,  G06T7/529 ,  G06T13/40 ,  G06T15/04 ,  G06T15/50 ,  G06V40/16

CPC classification number: G06T15/80 ,  G06T7/507 ,  G06T7/529 ,  G06T13/40 ,  G06T15/04 ,  G06T15/506 ,  G06V40/175 ,  G06T2207/10012 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/30201

Abstract: Rendering an avatar in a selected environment may include determining as inputs into an inferred shading network, an expression geometry to be represented by an avatar, head pose, and camera angle, along with a lighting representation for the selected environment. The inferred shading network may then generate a texture of a face to be utilized in rendering the avatar. The lighting representation may be obtained as lighting latent variables which are obtained from an environment autoencoder trained on environment images with various lighting conditions.

公开(公告)号：US11830182B1

公开(公告)日：2023-11-28

申请号：US16998746

申请日：2020-08-20

Applicant: Apple Inc.

Inventor： Olivier Soares ,  Andrew P. Mason

IPC: G06T7/00 ,  G06T13/40 ,  G06T17/20 ,  G06T15/04

CPC classification number: G06T7/0012 ,  G06T13/40 ,  G06T15/04 ,  G06T17/20 ,  G06T2207/30201

Abstract: Rendering an avatar may include determining an expression to be represented by an avatar, obtaining a blood texture map associated with the expression, wherein the blood texture map represents an offset of coloration from an albedo map for the expression, and rendering the avatar utilizing the blood texture map.