公开(公告)号：US20240169563A1

公开(公告)日：2024-05-23

申请号：US18509627

申请日：2023-11-15

Applicant: NVIDIA Corporation

Inventor： Bowen Wen ,  Jonathan Tremblay ,  Valts Blukis ,  Jan Kautz ,  Stanley Thomas Birchfield

IPC: G06T7/246 ,  G06T7/11 ,  G06T7/70 ,  G06T17/00 ,  G06T19/00

CPC classification number: G06T7/248 ,  G06T7/11 ,  G06T7/70 ,  G06T17/00 ,  G06T19/006 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/10028 ,  G06T2207/20072 ,  G06T2207/20084 ,  G06T2207/30252

Abstract: Apparatuses, systems, and techniques for constructing a data structure to store a shape of an object based at least in part on a portion of multiple images, and obtaining poses of the object by tracking a pose of the object through the multiple images based at least in part on the data structure. Optionally, the poses may be used to generate a plan for a path of a device to travel, generate a rendering of at least a portion of a Mixed Reality (“MR”) display to be viewed by a user, and/or the like.

公开(公告)号：US20240273810A1

公开(公告)日：2024-08-15

申请号：US18430113

申请日：2024-02-01

Applicant: NVIDIA Corporation

Inventor： Ankit Goyal ,  Jie Xu ,  Yijie Guo ,  Valts Blukis ,  Yu-Wei Chao ,  Dieter Fox

IPC: G06T15/10 ,  G05D1/243 ,  G05D101/15 ,  G06T7/55

CPC classification number: G06T15/10 ,  G05D1/2435 ,  G06T7/55 ,  G05D2101/15 ,  G06T2207/20084

Abstract: In various examples, a machine may generate, using sensor data capturing one or more views of an environment, a virtual environment including a 3D representation of the environment. The machine may render, using one or more virtual sensors in the virtual environment, one or more images of the 3D representation of the environment. The machine may apply the one or more images to one or more machine learning models (MLMs) trained to generate one or more predictions corresponding to the environment. The machine may perform one or more control operations based at least on the one or more predictions generated using the one or more MLMs.

公开(公告)号：US20240153196A1

公开(公告)日：2024-05-09

申请号：US18218527

申请日：2023-07-05

Applicant: NVIDIA Corporation

Inventor： Valts Blukis ,  Taeyeop Lee ,  Jonathan Tremblay ,  Bowen Wen ,  Dieter Fox ,  Stanley Thomas Birchfield

IPC: G06T15/06 ,  G06T1/20 ,  G06T7/70 ,  G06T7/90 ,  G06V10/82 ,  H04N13/117

CPC classification number: G06T15/06 ,  G06T1/20 ,  G06T7/70 ,  G06T7/90 ,  G06V10/82 ,  H04N13/117 ,  G06T2207/10024 ,  G06V2201/07

Abstract: Apparatuses, systems, and techniques to generate an image of one or more objects. In at least one embodiment, an image of one or more objects is generated using a neural network based on, for example, a representation of a scene.

公开(公告)号：US20240123620A1

公开(公告)日：2024-04-18

申请号：US18219031

申请日：2023-07-06

Applicant: NVIDIA Corporation

Inventor： Jonathan Tremblay ,  Stanley Thomas Birchfield ,  Valts Blukis ,  Bowen Wen ,  Dieter Fox ,  Taeyeop Lee

IPC: B25J9/16

CPC classification number: B25J9/1669 ,  B25J9/161 ,  B25J9/1697

Abstract: Apparatuses, systems, and techniques to generate and select grasp proposals. In at least one embodiment, grasp proposals are generated and selected using one or more neural networks, based on, for example, a latent code corresponding to an object.

公开(公告)号：US20240095077A1

公开(公告)日：2024-03-21

申请号：US18122594

申请日：2023-03-16

Applicant: NVIDIA Corporation

Inventor： Ishika Singh ,  Arsalan Mousavian ,  Ankit Goyal ,  Danfei Xu ,  Jonathan Tremblay ,  Dieter Fox ,  Animesh Garg ,  Valts Blukis

IPC: G06F9/50 ,  G06N20/00

CPC classification number: G06F9/5027 ,  G06N20/00

Abstract: Apparatuses, systems, and techniques to generate a prompt for one or more machine learning processes. In at least one embodiment, the machine learning process(es) generate(s) a plan to perform a task (identified in the prompt) that is to be performed by an agent (real world or virtual).

公开(公告)号：US20230271330A1

公开(公告)日：2023-08-31

申请号：US18055569

申请日：2022-11-15

Applicant: Nvidia Corporation

Inventor： Balakumar Sundaralingam ,  Pratyusha Sharma ,  Christopher Jason Paxton ,  Valts Blukis ,  Tucker Hermans ,  Dieter Fox

IPC: B25J13/00 ,  B25J9/16 ,  B25J19/02

CPC classification number: B25J13/003 ,  B25J9/1664 ,  B25J9/163 ,  B25J9/161 ,  B25J19/023

Abstract: Approaches presented herein provide for a framework to integrate human provided feedback in natural language to update a robot planning cost or value. The natural language feedback may be modeled as a cost or value associated with completing a task assigned to the robot. This cost or value may then be added to an initial task cost or value to update one or more actions to be performed by the robot. The framework can be applied to both real work and simulated environments where the robot may receive instructions, in natural language, that either provide a goal, modify an existing goal, or provide constraints to actions to achieve an existing goal.

公开(公告)号：US20240371082A1

公开(公告)日：2024-11-07

申请号：US18772058

申请日：2024-07-12

Applicant: NVIDIA Corporation

Inventor： Ankit Goyal ,  Valts Blukis ,  Jie Xu ,  Yijie Guo ,  Yu-Wei Chao ,  Dieter Fox

IPC: G06T15/20 ,  B25J9/16 ,  G06T7/73 ,  G06T19/20

Abstract: In various examples, an autonomous system may use a multi-stage process to solve three-dimensional (3D) manipulation tasks from a minimal number of demonstrations and predict key-frame poses with higher precision. In a first stage of the process, for example, the disclosed systems and methods may predict an area of interest in an environment using a virtual environment. The area of interest may correspond to a predicted location of an object in the environment, such as an object that an autonomous machine is instructed to manipulate. In a second stage, the systems may magnify the area of interest and render images of the virtual environment using a 3D representation of the environment that magnifies the area of interest. The systems may then use the rendered images to make predictions related to key-frame poses associated with a future (e.g., next) state of the autonomous machine.

公开(公告)号：US20220374723A1

公开(公告)日：2022-11-24

申请号：US17316564

申请日：2021-05-10

Applicant: NVIDIA Corporation

Inventor： Valts Blukis ,  Christopher Jason Paxton ,  Animesh Garg ,  Dieter Fox

IPC: G06N5/00 ,  G06F16/332 ,  G06K9/62 ,  G06N3/08

Abstract: Apparatuses, systems, and techniques to perform a language-guided distributional tree search based at least in part on a natural language task. In at least one embodiment, a tree search is performed using one or more neural networks to determine an action to be performed by an autonomous agent.