公开(公告)号：US12190428B2

公开(公告)日：2025-01-07

申请号：US18333647

申请日：2023-06-13

Applicant: Meta Platforms Technologies, LLC

Inventor： Jason Saragih ,  Stephen Anthony Lombardi ,  Shunsuke Saito ,  Tomas Simon Kreuz ,  Shih-En Wei ,  Kevyn Alex Anthony McPhail ,  Yaser Sheikh ,  Sai Bi

IPC: G06T13/40 ,  G06T11/00 ,  G06T15/04 ,  G06T15/50 ,  G06T15/60

Abstract: A method for providing a relightable avatar of a subject to a virtual reality application is provided. The method includes retrieving multiple images including multiple views of a subject and generating an expression-dependent texture map and a view-dependent texture map for the subject, based on the images. The method also includes generating, based on the expression-dependent texture map and the view-dependent texture map, a view of the subject illuminated by a light source selected from an environment in an immersive reality application, and providing the view of the subject to an immersive reality application running in a client device. A non-transitory, computer-readable medium storing instructions and a system that executes the instructions to perform the above method are also provided.

公开(公告)号：US20230326112A1

公开(公告)日：2023-10-12

申请号：US18333647

申请日：2023-06-13

Applicant: Meta Platforms Technologies, LLC

Inventor： Jason Saragih ,  Stephen Anthony Lombardi ,  Shunsuke Saito ,  Tomas Simon Kreuz ,  Shih-En Wei ,  Kevyn Alex Anthony McPhail ,  Yaser Sheikh ,  Sai Bi

IPC: G06T13/40 ,  G06T15/04 ,  G06T15/60 ,  G06T15/50 ,  G06T11/00

CPC classification number: G06T13/40 ,  G06T15/04 ,  G06T15/60 ,  G06T15/506 ,  G06T11/001 ,  G06T2215/12

Abstract: A method for providing a relightable avatar of a subject to a virtual reality application is provided. The method includes retrieving multiple images including multiple views of a subject and generating an expression-dependent texture map and a view-dependent texture map for the subject, based on the images. The method also includes generating, based on the expression-dependent texture map and the view-dependent texture map, a view of the subject illuminated by a light source selected from an environment in an immersive reality application, and providing the view of the subject to an immersive reality application running in a client device. A non-transitory, computer-readable medium storing instructions and a system that executes the instructions to perform the above method are also provided.

公开(公告)号：US11715248B2

公开(公告)日：2023-08-01

申请号：US17580486

申请日：2022-01-20

Applicant: Meta Platforms Technologies, LLC

Inventor： Jason Saragih ,  Stephen Anthony Lombardi ,  Shunsuke Saito ,  Tomas Simon Kreuz ,  Shih-En Wei ,  Kevyn Alex Anthony McPhail ,  Yaser Sheikh ,  Sai Bi

IPC: G06T13/40 ,  G06T15/04 ,  G06T15/60 ,  G06T15/50 ,  G06T11/00

CPC classification number: G06T13/40 ,  G06T11/001 ,  G06T15/04 ,  G06T15/506 ,  G06T15/60 ,  G06T2215/12

Abstract: A method for providing a relightable avatar of a subject to a virtual reality application is provided. The method includes retrieving multiple images including multiple views of a subject and generating an expression-dependent texture map and a view-dependent texture map for the subject, based on the images. The method also includes generating, based on the expression-dependent texture map and the view-dependent texture map, a view of the subject illuminated by a light source selected from an environment in an immersive reality application, and providing the view of the subject to an immersive reality application running in a client device. A non-transitory, computer-readable medium storing instructions and a system that executes the instructions to perform the above method are also provided.