公开(公告)号：US20250157114A1

公开(公告)日：2025-05-15

申请号：US18623745

申请日：2024-04-01

Applicant: NVIDIA Corporation

Inventor： Ye YUAN ,  Xueting LI ,  Umar IQBAL ,  Koki NAGANO ,  Shalini DE MELLO ,  Jan KAUTZ

IPC: G06T13/40 ,  G06T17/20

Abstract: In various examples, systems and methods are disclosed relating to generating animatable characters or avatars. The system can assign a plurality of first elements of a three-dimensional (3D) model of a subject to a plurality of locations on a surface of the subject in an initial pose. Further, the system can assign a plurality of second elements to the plurality of first elements, each second element of the plurality of second elements having an opacity corresponding to a distance between the second element and the surface of the subject. Further, the system can update the plurality of second elements based at least on a target pose for the subject and one or more attributes of the subject to determine a plurality of updated second elements. Further, the system can render a representation of the subject based at least on the plurality of updated second elements.

公开(公告)号：US20240153188A1

公开(公告)日：2024-05-09

申请号：US18455084

申请日：2023-08-24

Applicant: NVIDIA Corporation

Inventor： Jingbo WANG ,  Ye YUAN ,  Cheng XIE ,  Sanja FIDLER ,  Jan KAUTZ ,  Umar IQBAL ,  Zan GOJCIC ,  Sameh KHAMIS

IPC: G06T13/40 ,  G06T7/246

CPC classification number: G06T13/40 ,  G06T7/251 ,  G06T2207/20084 ,  G06T2210/21

Abstract: In various examples, systems and methods are disclosed relating to generating physics-plausible whole body motion, including determining a mesh sequence corresponding to a motion of at least one dynamic character of one or more dynamic characters and a mesh of a terrain using a video sequence, determining using a generative model and based at least one the mesh sequence and the mesh of the terrain, an occlusion-free motion of the at least one dynamic character by infilling physics-plausible character motions in the mesh sequence for at least one frame of the video sequence that includes an occlusion of at least a portion of the at least one dynamic character, and determining physics-plausible whole body motion of the at least one dynamic character by applying physics-based imitation upon the occlusion-free motion.