公开(公告)号：US20220207831A1

公开(公告)日：2022-06-30

申请号：US17556429

申请日：2021-12-20

Applicant: Facebook Technologies, LLC

Inventor： Jason Saragih ,  Shih-En Wei ,  Tomas Simon Kreuz ,  Kris Makoto Kitani ,  Ye Yuan

IPC: G06T19/00 ,  G06V40/20 ,  G06T15/10 ,  G06V40/10

Abstract: A method for simulating a solid body animation of a subject includes retrieving a first frame that includes a body image of a subject. The method also includes selecting, from the first frame, multiple key points within the body image of the subject that define a hull of a body part and multiple joint points that define a joint between two body parts, identifying a geometry, a speed, and a mass of the body part to include in a dynamic model of the subject, based on the key points and the joint points, determining, based on the dynamic model of the subject, a pose of the subject in a second frame after the first frame in a video stream, and providing the video stream to an immersive reality application running on a client device.