公开(公告)号：US20240153188A1

公开(公告)日：2024-05-09

申请号：US18455084

申请日：2023-08-24

Applicant: NVIDIA Corporation

Inventor： Jingbo WANG ,  Ye YUAN ,  Cheng XIE ,  Sanja FIDLER ,  Jan KAUTZ ,  Umar IQBAL ,  Zan GOJCIC ,  Sameh KHAMIS

IPC: G06T13/40 ,  G06T7/246

CPC classification number: G06T13/40 ,  G06T7/251 ,  G06T2207/20084 ,  G06T2210/21

Abstract: In various examples, systems and methods are disclosed relating to generating physics-plausible whole body motion, including determining a mesh sequence corresponding to a motion of at least one dynamic character of one or more dynamic characters and a mesh of a terrain using a video sequence, determining using a generative model and based at least one the mesh sequence and the mesh of the terrain, an occlusion-free motion of the at least one dynamic character by infilling physics-plausible character motions in the mesh sequence for at least one frame of the video sequence that includes an occlusion of at least a portion of the at least one dynamic character, and determining physics-plausible whole body motion of the at least one dynamic character by applying physics-based imitation upon the occlusion-free motion.