公开(公告)号：US11348299B2

公开(公告)日：2022-05-31

申请号：US16773133

申请日：2020-01-27

Applicant: Apple Inc.

Inventor： Sofien Bouaziz ,  Mark Pauly

IPC: G06T13/40 ,  G06T7/292 ,  G06V40/16 ,  G06T15/50

Abstract: Embodiments relate to a method for real-time facial animation, and a processing device for real-time facial animation. The method includes providing a dynamic expression model, receiving tracking data corresponding to a facial expression of a user, estimating tracking parameters based on the dynamic expression model and the tracking data, and refining the dynamic expression model based on the tracking data and estimated tracking parameters. The method may further include generating a graphical representation corresponding to the facial expression of the user based on the tracking parameters. Embodiments pertain to a real-time facial animation system.

公开(公告)号：US20210174567A1

公开(公告)日：2021-06-10

申请号：US17111083

申请日：2020-12-03

Applicant: Apple Inc.

Inventor： Thibaut Weise ,  Sofien Bouaziz ,  Hao Li ,  Mark Pauly

IPC: G06T13/40 ,  G06K9/00 ,  G06K9/62

Abstract: A method of animating a digital character according to facial expressions of a user, comprising the steps of, (a) obtaining a 2D image and 3D depth map of the face of the user, (b) determining expression parameters for a user expression model so that a facial expression of the user-specific expression model represents the face of the user shown in the 2D image and 3D depth map (c) using the expression parameters and an animation prior to determine animation parameters usable to animate a digital character, wherein the animation prior is a sequence of animation parameters which represent predefined animations of a digital character (d) using the animation parameters to animate a digital character so that the digital character mimics the face of the user.

公开(公告)号：US11836838B2

公开(公告)日：2023-12-05

申请号：US17111083

申请日：2020-12-03

Applicant: Apple Inc.

Inventor： Thibaut Weise ,  Sofien Bouaziz ,  Hao Li ,  Mark Pauly

IPC: G06T13/40 ,  G06V40/16 ,  G06F18/2135 ,  G06F18/2415 ,  G06V10/764 ,  G06V10/77

CPC classification number: G06T13/40 ,  G06F18/2135 ,  G06F18/2415 ,  G06V10/764 ,  G06V10/7715 ,  G06V40/176

Abstract: A method of animating a digital character according to facial expressions of a user, comprising the steps of, (a) obtaining a 2D image and 3D depth map of the face of the user, (b) determining expression parameters for a user expression model so that a facial expression of the user-specific expression model represents the face of the user shown in the 2D image and 3D depth map (c) using the expression parameters and an animation prior to determine animation parameters usable to animate a digital character, wherein the animation prior is a sequence of animation parameters which represent predefined animations of a digital character (d) using the animation parameters to animate a digital character so that the digital character mimics the face of the user.

公开(公告)号：US10586372B2

公开(公告)日：2020-03-10

申请号：US16259818

申请日：2019-01-28

Applicant: Apple Inc.

Inventor： Sofien Bouaziz ,  Mark Pauly

IPC: G06T13/40 ,  G06T7/292 ,  G06K9/00 ,  G06T15/50

Abstract: Embodiments relate to a method for real-time facial animation, and a processing device for real-time facial animation. The method includes providing a dynamic expression model, receiving tracking data corresponding to a facial expression of a user, estimating tracking parameters based on the dynamic expression model and the tracking data, and refining the dynamic expression model based on the tracking data and estimated tracking parameters. The method may further include generating a graphical representation corresponding to the facial expression of the user based on the tracking parameters. Embodiments pertain to a real-time facial animation system.

公开(公告)号：US10861211B2

公开(公告)日：2020-12-08

申请号：US16025793

申请日：2018-07-02

Applicant: Apple Inc.

Inventor： Thibaut Weise ,  Sofien Bouaziz ,  Hao Li ,  Mark Pauly

IPC: G06T13/40 ,  G06K9/00 ,  G06K9/62

Abstract: A method of animating a digital character according to facial expressions of a user, comprising the steps of, (a) obtaining a 2D image and 3D depth map of the face of the user, (b) determining expression parameters for a user expression model so that a facial expression of the user-specific expression model represents the face of the user shown in the 2D image and 3D depth map (c) using the expression parameters and an animation prior to determine animation parameters usable to animate a digital character, wherein the animation prior is a sequence of animation parameters which represent predefined animations of a digital character (d) using the animation parameters to animate a digital character so that the digital character mimics the face of the user.

公开(公告)号：US11948238B2

公开(公告)日：2024-04-02

申请号：US17804326

申请日：2022-05-27

Applicant: Apple Inc.

Inventor： Sofien Bouaziz ,  Mark Pauly

IPC: G06K9/00 ,  G06T7/292 ,  G06T13/40 ,  G06T15/50 ,  G06V40/16

CPC classification number: G06T13/40 ,  G06T7/292 ,  G06T15/503 ,  G06V40/176

Abstract: Embodiments relate to a method for real-time facial animation, and a processing device for real-time facial animation. The method includes providing a dynamic expression model, receiving tracking data corresponding to a facial expression of a user, estimating tracking parameters based on the dynamic expression model and the tracking data, and refining the dynamic expression model based on the tracking data and estimated tracking parameters. The method may further include generating a graphical representation corresponding to the facial expression of the user based on the tracking parameters. Embodiments pertain to a real-time facial animation system.

公开(公告)号：US20230343013A1

公开(公告)日：2023-10-26

申请号：US18314604

申请日：2023-05-09

Applicant: Apple Inc.

Inventor： Thibaut Weise ,  Sofien Bouaziz ,  Hao Li ,  Mark Pauly

IPC: G06T13/40 ,  G06V10/764 ,  G06V10/77 ,  G06V40/16

CPC classification number: G06T13/40 ,  G06V10/764 ,  G06F18/2415 ,  G06V10/7715 ,  G06V40/176 ,  G06F18/2135

Abstract: A method of animating a digital character according to facial expressions of a user, comprising the steps of, (a) obtaining a 2D image and 3D depth map of the face of the user, (b) determining expression parameters for a user expression model so that a facial expression of the user-specific expression model represents the face of the user shown in the 2D image and 3D depth map (c) using the expression parameters and an animation prior to determine animation parameters usable to animate a digital character, wherein the animation prior is a sequence of animation parameters which represent predefined animations of a digital character (d) using the animation parameters to animate a digital character so that the digital character mimics the face of the user.