公开(公告)号：US20240185523A1

公开(公告)日：2024-06-06

申请号：US18339936

申请日：2023-06-22

Applicant: NVIDIA CORPORATION

Inventor： Dongsu ZHANG ,  Amlan KAR ,  Francis WILLIAMS ,  Zan GOJCIC ,  Karsten KREIS ,  Sanja FIDLER

IPC: G06T17/10

CPC classification number: G06T17/10

Abstract: In various examples, a technique for performing three-dimensional (3D) scene completion includes determining an initial representation of a first 3D scene. The technique also includes executing a machine learning model to generate a first update to the initial representation at a previous time step and a second update to the initial representation at a current time step, wherein the second update is generated based at least on a threshold applied to a set of predictions corresponding to the first update. The technique also includes generating a 3D model of the 3D scene based at least on the second update to the initial representation.

公开(公告)号：US20240153188A1

公开(公告)日：2024-05-09

申请号：US18455084

申请日：2023-08-24

Applicant: NVIDIA Corporation

Inventor： Jingbo WANG ,  Ye YUAN ,  Cheng XIE ,  Sanja FIDLER ,  Jan KAUTZ ,  Umar IQBAL ,  Zan GOJCIC ,  Sameh KHAMIS

IPC: G06T13/40 ,  G06T7/246

CPC classification number: G06T13/40 ,  G06T7/251 ,  G06T2207/20084 ,  G06T2210/21

Abstract: In various examples, systems and methods are disclosed relating to generating physics-plausible whole body motion, including determining a mesh sequence corresponding to a motion of at least one dynamic character of one or more dynamic characters and a mesh of a terrain using a video sequence, determining using a generative model and based at least one the mesh sequence and the mesh of the terrain, an occlusion-free motion of the at least one dynamic character by infilling physics-plausible character motions in the mesh sequence for at least one frame of the video sequence that includes an occlusion of at least a portion of the at least one dynamic character, and determining physics-plausible whole body motion of the at least one dynamic character by applying physics-based imitation upon the occlusion-free motion.

公开(公告)号：US20250086896A1

公开(公告)日：2025-03-13

申请号：US18465363

申请日：2023-09-12

Applicant: NVIDIA Corporation

Inventor： Or LITANY ,  Sanja FIDLER ,  Cho-Ying WU ,  Huan LING ,  Zan GOJCIC ,  Riccardo DE LUTIO ,  Sameh KHAMIS

IPC: G06T19/00 ,  G06T7/194 ,  G06V10/25 ,  G06V10/44 ,  G06V10/764 ,  G06V10/82

Abstract: In various examples, systems and methods are disclosed relating to neural networks for three-dimensional (3D) scene representations and modifying the 3D scene representations. In some implementations, a diffusion model can be configured to modify selected portions of 3D scenes represented using neural radiance fields, without painting back in content of the selected portions that was originally present. A first view of the neural radiance fields can be inpainted to remove a target feature from the first view, and used as guidance for updating the neural radiance field so that the target feature can be realistically removed from various second views of the neural radiance fields while context is retained outside of the selected portions.