公开(公告)号：US20240221296A1

公开(公告)日：2024-07-04

申请号：US18609609

申请日：2024-03-19

Applicant: Apple Inc.

Inventor： Andrew P. Mason ,  Olivier Soares ,  Haarm-Pieter Duiker ,  John S. McCarten

IPC: G06T15/80 ,  G06T7/507 ,  G06T7/529 ,  G06T13/40 ,  G06T15/04 ,  G06T15/50 ,  G06V40/16

CPC classification number: G06T15/80 ,  G06T7/507 ,  G06T7/529 ,  G06T13/40 ,  G06T15/04 ,  G06T15/506 ,  G06V40/175 ,  G06T2207/10012 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/30201

Abstract: Rendering an avatar in a selected environment may include determining as inputs into an inferred shading network, an expression geometry to be represented by an avatar, head pose, and camera angle, along with a lighting representation for the selected environment. The inferred shading network may then generate a texture of a face to be utilized in rendering the avatar. The lighting representation may be obtained as lighting latent variables which are obtained from an environment autoencoder trained on environment images with various lighting conditions.

公开(公告)号：US20240005537A1

公开(公告)日：2024-01-04

申请号：US18214604

申请日：2023-06-27

Applicant: Apple Inc.

Inventor： Brian Amberg ,  John S. McCarten ,  Nicolas V. Scapel ,  Peter Kaufmann ,  Sebastian Martin

IPC: G06T7/521 ,  G06V40/16 ,  G06T13/40

CPC classification number: G06T7/521 ,  G06V40/176 ,  G06T13/40

Abstract: Various implementations disclosed herein include devices, systems, and methods that generates values for a representation of a face of a user. For example, an example process may include obtaining sensor data (e.g., live data) of a user, wherein the sensor data is associated with a point in time, generating a set of values representing the user based on the sensor data, and providing the set of values, where a depiction of the user at the point in time is displayed based on the set of values. In some implementations, the set of values includes depth values that define three-dimensional (3D) positions of portions of the user relative to multiple 3D positions of points of a projected surface and appearance values (e.g., color, texture, opacity, etc.) that define appearances of the portions of the user.

公开(公告)号：US20230290082A1

公开(公告)日：2023-09-14

申请号：US18125277

申请日：2023-03-23

Applicant: APPLE INC.

Inventor： Brian Amberg ,  Nicolas V. Scapel ,  Jason D. Rickwald ,  Dorian D. Dargan ,  Gary I. Butcher ,  Giancarlo Yerkes ,  William D. Lindmeier ,  John S. McCarten

IPC: G06T19/00 ,  G06T17/00 ,  G06T5/00 ,  G06T7/246 ,  G06T13/40

CPC classification number: G06T19/006 ,  G06T17/00 ,  G06T5/001 ,  G06T7/246 ,  G06T13/40 ,  G06T2207/30201

Abstract: Various implementations disclosed herein include devices, systems, and methods that generates and displays a portion of a representation of a face of a user. For example, an example process may include obtaining a first set of data corresponding to features of a face of a user in a plurality of configurations, while a user is using an electronic device, obtaining a second set of data corresponding to one or more partial views of the face from one or more image sensors, generating a representation of the face of the user based on the first set of data and the second set of data, wherein portions of the representation correspond to different confidence values, and displaying the portions of the representation based on the corresponding confidence values.