-
公开(公告)号：US11734888B2
公开(公告)日：2023-08-22
申请号：US17396534
申请日：2021-08-06
Applicant: Meta Platforms Technologies, LLC
Inventor： Chen Cao , Vasu Agrawal , Fernando De la Torre , Lele Chen , Jason Saragih , Tomas Simon Kreuz , Yaser Sheikh
CPC classification number: G06T17/20 , G06N3/045 , G06T7/586 , G06T7/73 , G06T13/40 , G06T15/04 , G06V40/165 , G06V40/176
Abstract: A method for providing real-time three-dimensional facial animation from video is provided. The method includes collecting images of a subject, and forming a three-dimensional mesh for the subject based on a facial expression factor and a head pose of the subject extracted from the images of the subject. The method also includes forming a texture transformation based on an illumination parameter associated with an illumination configuration for the images from the subject, forming a three-dimensional model for the subject based on the three-dimensional mesh and the texture transformation, determining a loss factor based on selected points in a test image from the subject and a rendition of the test image by the three-dimensional model, and updating the three-dimensional model according to the loss factor. A system and a non-transitory, computer-readable medium storing instructions to perform the above method are also provided.
-
公开(公告)号：US20230245365A1
公开(公告)日：2023-08-03
申请号：US18074346
申请日：2022-12-02
Applicant: Meta Platforms Technologies, LLC
Inventor： Chen Cao , Stuart Anderson , Tomas Simon Kreuz , Jin Kyu Kim , Gabriel Bailowitz Schwartz , Michael Zollhoefer , Shunsuke Saito , Stephen Anthony Lombardi , Shih-En Wei , Danielle Belko , Shoou-I Yu , Yaser Sheikh , Jason Saragih
IPC: G06T13/40
CPC classification number: G06T13/40
Abstract: A method for generating a subject avatar using a mobile phone scan is provided. The method includes receiving, from a mobile device, multiple images of a first subject, extracting multiple image features from the images of the first subject based on a set of learnable weights, inferring a three-dimensional model of the first subject from the image features and an existing three-dimensional model of a second subject, animating the three-dimensional model of the first subject based on an immersive reality application running on a headset used by a viewer, and providing, to a display on the headset, an image of the three-dimensional model of the first subject. A system and a non-transitory, computer-readable medium storing instructions to perform the above method, are also provided.
-
公开(公告)号：US20220358719A1
公开(公告)日：2022-11-10
申请号：US17396534
申请日：2021-08-06
Applicant: Meta Platforms Technologies, LLC
Inventor： Chen Cao , Vasu Agrawal , Fernando De la Torre , Lele Chen , Jason Saragih , Tomas Simon Kreuz , Yaser Sheikh
Abstract: A method for providing real-time three-dimensional facial animation from video is provided. The method includes collecting images of a subject, and forming a three-dimensional mesh for the subject based on a facial expression factor and a head pose of the subject extracted from the images of the subject. The method also includes forming a texture transformation based on an illumination parameter associated with an illumination configuration for the images from the subject, forming a three-dimensional model for the subject based on the three-dimensional mesh and the texture transformation, determining a loss factor based on selected points in a test image from the subject and a rendition of the test image by the three-dimensional model, and updating the three-dimensional model according to the loss factor. A system and a non-transitory, computer-readable medium storing instructions to perform the above method are also provided.
-
公开(公告)号：US20240242455A1
公开(公告)日：2024-07-18
申请号：US18411615
申请日：2024-01-12
Applicant: Meta Platforms Technologies, LLC
Inventor： Albert Pumarola Peris , Thu Nguyen Phuoc , Chen Cao , Artsiom Sanakoyeu , Tao Xu , Tomas Simon Kreuz , Ali Thabet , Juan Camilo Perez
CPC classification number: G06T19/20 , G06T13/40 , G06T2219/2024
Abstract: As disclosed herein, a computer-implemented method is provided. In one aspect, the computer-implemented method may include receiving, from a client device, images of a user. The computer-implemented method may include determining a target appearance of an avatar of the user. The computer-implemented method may include generating, based on the images and the target appearance, renders of the avatar. The computer-implemented method may include determining, based on a difference between first and second renders, a first adjustment to a weight associated with a first parameter for generating the renders and a second adjustment to a weight associated with a second parameter for generating the renders. The computer-implemented method may include generating, based on the adjustments, a third render of the avatar, the third render appearing more similar to the target appearance relative to the first render and the second render. A system and a non-transitory computer-readable storage medium are also disclosed.
-
-
-
Search Results
4
records
(took 0.014 seconds)
