公开(公告)号：US20230234233A1

公开(公告)日：2023-07-27

申请号：US17585394

申请日：2022-01-26

Applicant: NVIDIA Corporation

Inventor： Ankit Goyal ,  Arsalan Mousavian ,  Christopher Jason Paxton ,  Yu-Wei Chao ,  Dieter Fox

IPC: B25J9/16 ,  G06T7/70 ,  G06T7/50 ,  G06T7/269 ,  G06T7/10 ,  B25J13/08 ,  G05B13/02

CPC classification number: B25J9/1697 ,  G06T7/70 ,  G06T7/50 ,  G06T7/269 ,  G06T7/10 ,  B25J13/08 ,  G05B13/027 ,  G06T2207/10024 ,  G06T2207/20084 ,  B60W60/001

Abstract: Apparatuses, systems, and techniques to place one or more objects in a location and orientation. In at least one embodiment, one or more circuits are to use one or more neural networks to cause one or more autonomous devices to place one or more objects in a location and orientation based, at least in part, on one or more images of the location and orientation.

公开(公告)号：US20240095077A1

公开(公告)日：2024-03-21

申请号：US18122594

申请日：2023-03-16

Applicant: NVIDIA Corporation

Inventor： Ishika Singh ,  Arsalan Mousavian ,  Ankit Goyal ,  Danfei Xu ,  Jonathan Tremblay ,  Dieter Fox ,  Animesh Garg ,  Valts Blukis

IPC: G06F9/50 ,  G06N20/00

CPC classification number: G06F9/5027 ,  G06N20/00

Abstract: Apparatuses, systems, and techniques to generate a prompt for one or more machine learning processes. In at least one embodiment, the machine learning process(es) generate(s) a plan to perform a task (identified in the prompt) that is to be performed by an agent (real world or virtual).

公开(公告)号：US20240273810A1

公开(公告)日：2024-08-15

申请号：US18430113

申请日：2024-02-01

Applicant: NVIDIA Corporation

Inventor： Ankit Goyal ,  Jie Xu ,  Yijie Guo ,  Valts Blukis ,  Yu-Wei Chao ,  Dieter Fox

IPC: G06T15/10 ,  G05D1/243 ,  G05D101/15 ,  G06T7/55

CPC classification number: G06T15/10 ,  G05D1/2435 ,  G06T7/55 ,  G05D2101/15 ,  G06T2207/20084

Abstract: In various examples, a machine may generate, using sensor data capturing one or more views of an environment, a virtual environment including a 3D representation of the environment. The machine may render, using one or more virtual sensors in the virtual environment, one or more images of the 3D representation of the environment. The machine may apply the one or more images to one or more machine learning models (MLMs) trained to generate one or more predictions corresponding to the environment. The machine may perform one or more control operations based at least on the one or more predictions generated using the one or more MLMs.

公开(公告)号：US20240371082A1

公开(公告)日：2024-11-07

申请号：US18772058

申请日：2024-07-12

Applicant: NVIDIA Corporation

Inventor： Ankit Goyal ,  Valts Blukis ,  Jie Xu ,  Yijie Guo ,  Yu-Wei Chao ,  Dieter Fox

IPC: G06T15/20 ,  B25J9/16 ,  G06T7/73 ,  G06T19/20

Abstract: In various examples, an autonomous system may use a multi-stage process to solve three-dimensional (3D) manipulation tasks from a minimal number of demonstrations and predict key-frame poses with higher precision. In a first stage of the process, for example, the disclosed systems and methods may predict an area of interest in an environment using a virtual environment. The area of interest may correspond to a predicted location of an object in the environment, such as an object that an autonomous machine is instructed to manipulate. In a second stage, the systems may magnify the area of interest and render images of the virtual environment using a 3D representation of the environment that magnifies the area of interest. The systems may then use the rendered images to make predictions related to key-frame poses associated with a future (e.g., next) state of the autonomous machine.