公开(公告)号：US20240241573A1

公开(公告)日：2024-07-18

申请号：US18411623

申请日：2024-01-12

Applicant: Meta Platforms Technologies, LLC

Inventor： Albert Pumarola Peris ,  Yuming Du ,  Robin Kips ,  Wolfram Sebastian Starke ,  Ali Thabet ,  Artsiom Sanakoyeu

IPC: G06F3/01 ,  G06F3/0346

CPC classification number: G06F3/011 ,  G06F3/0346

Abstract: A method for full body motion tracking includes receiving tracking signals from a plurality of sensors associated with an upper body of a person, and based on the tracking signals, determining motion features and joint features. The method further includes training a diffusion model that includes a multi-layer perceptron (MLP) network, and generating a multiple inputs to the trained diffusion model, the inputs including the motion features and the joint features. The method includes providing the inputs to the trained diffusion model to generate multiple outputs. The outputs include sequences of full body poses, the sequences of full body poses including upper body poses and lower body poses.

公开(公告)号：US20240242455A1

公开(公告)日：2024-07-18

申请号：US18411615

申请日：2024-01-12

Applicant: Meta Platforms Technologies, LLC

Inventor： Albert Pumarola Peris ,  Thu Nguyen Phuoc ,  Chen Cao ,  Artsiom Sanakoyeu ,  Tao Xu ,  Tomas Simon Kreuz ,  Ali Thabet ,  Juan Camilo Perez

IPC: G06T19/20 ,  G06T13/40

CPC classification number: G06T19/20 ,  G06T13/40 ,  G06T2219/2024

Abstract: As disclosed herein, a computer-implemented method is provided. In one aspect, the computer-implemented method may include receiving, from a client device, images of a user. The computer-implemented method may include determining a target appearance of an avatar of the user. The computer-implemented method may include generating, based on the images and the target appearance, renders of the avatar. The computer-implemented method may include determining, based on a difference between first and second renders, a first adjustment to a weight associated with a first parameter for generating the renders and a second adjustment to a weight associated with a second parameter for generating the renders. The computer-implemented method may include generating, based on the adjustments, a third render of the avatar, the third render appearing more similar to the target appearance relative to the first render and the second render. A system and a non-transitory computer-readable storage medium are also disclosed.