公开(公告)号：US20200249674A1

公开(公告)日：2020-08-06

申请号：US16268188

申请日：2019-02-05

Applicant: Nvidia Corporation

Inventor： Bill Dally ,  Stephen Tyree ,  Iuri Frosio ,  Alejandro Troccoli

IPC: G05D1/00 ,  G06N3/08 ,  G05D1/02

Abstract: Sensors measure information about actors or other objects near an object, such as a vehicle or robot, to be maneuvered. Sensor data is used to determine a sequence of possible actions for the maneuverable object to achieve a determined goal. For each possible action to be considered, one or more probable reactions of the nearby actors or objects are determined. This can take the form of a decision tree in some embodiments, with alternative levels of nodes corresponding to possible actions of the present object and probable reactive actions of one or more other vehicles or actors. Machine learning can be used to determine the probabilities, as well as to project out the options along the paths of the decision tree including the sequences. A value function is used to generate a value for each considered sequence, or path, and a path having a highest value is selected for use in determining how to navigate the object.

公开(公告)号：US09934153B2

公开(公告)日：2018-04-03

申请号：US14788593

申请日：2015-06-30

Applicant: NVIDIA Corporation

Inventor： Jason Lavar Clemons ,  Chih-Chi Cheng ,  Daniel Robert Johnson ,  Stephen William Keckler ,  Iuri Frosio ,  Yun-Ta Tsai

IPC: G06F12/0893

CPC classification number: G06F12/0893 ,  G06F2212/454 ,  G06F2212/455

Abstract: A patch memory system for accessing patches from a memory is disclosed. A patch is an abstraction that refers to a contiguous, array of data that is a subset of an N-dimensional array of data. The patch memory system includes a tile cache, and is configured to fetch data associated with a patch by determining one or more tiles associated with an N-dimensional array of data corresponding to the patch, and loading data for the one or more tiles from the memory into the tile cache. The N-dimensional array of data may be a two-dimensional (2D) digital image comprising a plurality of pixels. A patch of the 2D digital image may refer to a 2D subset of the image.

公开(公告)号：US20230325670A1

公开(公告)日：2023-10-12

申请号：US17820780

申请日：2022-08-18

Applicant: NVIDIA Corporation

Inventor： Jason Lavar Clemons ,  Stephen W. Keckler ,  Iuri Frosio ,  Jose Manuel Alvarez Lopez ,  Maying Shen

IPC: G06N3/08

CPC classification number: G06N3/082

Abstract: A technique for dynamically configuring and executing an augmented neural network in real-time according to performance constraints also maintains the legacy neural network execution path. A neural network model that has been trained for a task is augmented with low-compute “shallow” phases paired with each legacy phase and the legacy phases of the neural network model are held constant (e.g., unchanged) while the shallow phases are trained. During inference, one or more of the shallow phases can be selectively executed in place of the corresponding legacy phase. Compared with the legacy phases, the shallow phases are typically less accurate, but have reduced latency and consume less power. Therefore, processing using one or more of the shallow phases in place of one or more of the legacy phases enables the augmented neural network to dynamically adapt to changes in the execution environment (e.g., processing load or performance requirement).

公开(公告)号：US20220398283A1

公开(公告)日：2022-12-15

申请号：US17824680

申请日：2022-05-25

Applicant: NVIDIA Corporation

Inventor： Shie Mannor ,  Assaf Joseph Hallak ,  Gal Dalal ,  Steven Tarence Dalton ,  Iuri Frosio ,  Gal Chechik

IPC: G06F16/903 ,  G06F16/901

Abstract: A method for performing a Tree-Search (TS) on an environment is provided. The method comprises generating a tree for a current state of the environment based on a TS policy, determining a corrected TS policy, and determining an action to apply to the environment based on the corrected TS policy. The tree comprises a plurality of nodes including a root node among the plurality of nodes corresponding to the current state of the environment. Each node other than the root node among the plurality of nodes corresponding to an estimated future state of the environment. The plurality of nodes in the tree are connected by a plurality of edges. Each edge among the plurality of edges is associated with an action causing a transition from a first state to a different sate of the environment.

公开(公告)号：US11514293B2

公开(公告)日：2022-11-29

申请号：US16564978

申请日：2019-09-09

Applicant: NVIDIA Corporation

Inventor： Ruben Villegas ,  Alejandro Troccoli ,  Iuri Frosio ,  Stephen Tyree ,  Wonmin Byeon ,  Jan Kautz

IPC: G06N3/04 ,  G06N3/08 ,  B60W40/02

Abstract: In various examples, historical trajectory information of objects in an environment may be tracked by an ego-vehicle and encoded into a state feature. The encoded state features for each of the objects observed by the ego-vehicle may be used—e.g., by a bi-directional long short-term memory (LSTM) network—to encode a spatial feature. The encoded spatial feature and the encoded state feature for an object may be used to predict lateral and/or longitudinal maneuvers for the object, and the combination of this information may be used to determine future locations of the object. The future locations may be used by the ego-vehicle to determine a path through the environment, or may be used by a simulation system to control virtual objects—according to trajectories determined from the future locations—through a simulation environment.

公开(公告)号：US09830703B2

公开(公告)日：2017-11-28

申请号：US14825129

申请日：2015-08-12

Applicant: NVIDIA CORPORATION

Inventor： Gregory P. Meyer ,  Shalini Gupta ,  Iuri Frosio ,  Nagilla Dikpal Reddy ,  Jan Kautz

IPC: G06K9/00 ,  G06T7/00

CPC classification number: G06T7/507 ,  G06K9/6276 ,  G06T7/251 ,  G06T7/277 ,  G06T7/70 ,  G06T7/75 ,  G06T7/77 ,  G06T2200/28 ,  G06T2207/10016 ,  G06T2207/10028 ,  G06T2207/30201

Abstract: One embodiment of the present invention sets forth a technique for estimating a head pose of a user. The technique includes acquiring depth data associated with a head of the user and initializing each particle included in a set of particles with a different candidate head pose. The technique further includes performing one or more optimization passes that include performing at least one iterative closest point (ICP) iteration for each particle and performing at least one particle swarm optimization (PSO) iteration. Each ICP iteration includes rendering the three-dimensional reference model based on the candidate head pose associated with the particle and comparing the three-dimensional reference model to the depth data. Each PSO iteration comprises updating a global best head pose associated with the set of particles and modifying at least one candidate head pose. The technique further includes modifying a shape of the three-dimensional reference model based on depth data.

公开(公告)号：US20170263041A1

公开(公告)日：2017-09-14

申请号：US15421364

申请日：2017-01-31

Applicant: NVIDIA Corporation

Inventor： Iuri Frosio ,  Jan Kautz

IPC: G06T15/00 ,  G09G5/36

CPC classification number: G09G5/363 ,  G06T5/002

Abstract: A system, method and computer program product are provided for generating one or more values for a signal patch using neighboring patches collected based on a distance dynamically computed from a noise distribution of the signal patch. In use, a reference patch is identified from a signal, and a reference distance is computed based on a noise distribution in the reference patch. Neighbor patches are then collected from the signal based on the computed reference distance from the reference patch. Further, the collected neighbor patches are processed with the reference patch to generate one or more values for the reference patch.

公开(公告)号：US20250069191A1

公开(公告)日：2025-02-27

申请号：US18452634

申请日：2023-08-21

Applicant: NVIDIA Corporation

Inventor： Iuri Frosio ,  Mayoore Selvarasa Jaiswal ,  Jan Kautz ,  Jianyuan Min

IPC: G06T5/50 ,  H04N23/743

Abstract: Systems and methods are disclosed related to synthetic bracketing for exposure correction. A deep learning based method and system produces a set of differently exposed images from a single input image. The images in the set may be combined to produce an output image with improved global and local exposure compared with the input image. An image encoder applies learned parameters to each input image to generate a set of image features including local exposure estimates for each of two or more regions of the input image and a low resolution latent representation of the input image. A decoder receives the local exposure estimates, the latent representation, and target enhancements that are processed to generate synthesized transformations. When applied to the input image, the synthesized transformations produce the set of transformed images. Each transformed image is a version of the input image synthesized to correspond to a respective target enhancement.

公开(公告)号：US20230088912A1

公开(公告)日：2023-03-23

申请号：US17952866

申请日：2022-09-26

Applicant: NVIDIA Corporation

Inventor： Ruben Villegas ,  Alejandro Troccoli ,  Iuri Frosio ,  Stephen Tyree ,  Wonmin Byeon ,  Jan Kautz

IPC: G06N3/04 ,  G06N3/08 ,  B60W40/02

Abstract: In various examples, historical trajectory information of objects in an environment may be tracked by an ego-vehicle and encoded into a state feature. The encoded state features for each of the objects observed by the ego-vehicle may be used—e.g., by a bi-directional long short-term memory (LSTM) network—to encode a spatial feature. The encoded spatial feature and the encoded state feature for an object may be used to predict lateral and/or longitudinal maneuvers for the object, and the combination of this information may be used to determine future locations of the object. The future locations may be used by the ego-vehicle to determine a path through the environment, or may be used by a simulation system to control virtual objects—according to trajectories determined from the future locations—through a simulation environment.

公开(公告)号：US20170004089A1

公开(公告)日：2017-01-05

申请号：US14788593

申请日：2015-06-30

Applicant: NVIDIA Corporation

Inventor： Jason Lavar Clemons ,  Chih-Chi Cheng ,  Daniel Robert Johnson ,  Stephen William Keckler ,  Iuri Frosio ,  Yun-Ta Tsai

IPC: G06F12/08

CPC classification number: G06F12/0893 ,  G06F2212/454 ,  G06F2212/455

Abstract: A patch memory system for accessing patches from a memory is disclosed. A patch is an abstraction that refers to a contiguous, array of data that is a subset of an N-dimensional array of data. The patch memory system includes a tile cache, and is configured to fetch data associated with a patch by determining one or more tiles associated with an N-dimensional array of data corresponding to the patch, and loading data for the one or more tiles from the memory into the tile cache. The N-dimensional array of data may be a two-dimensional (2D) digital image comprising a plurality of pixels. A patch of the 2D digital image may refer to a 2D subset of the image.

Abstract translation: 公开了一种用于从存储器访问补丁的补丁存储器系统。 补丁是指一个连续的数据数组的抽象，它是N维数据数组的子集。 所述补丁存储器系统包括瓦片高速缓存，并且被配置为通过确定与对应于所述补丁的N维数组阵列相关联的一个或多个瓦片来提取与补丁相关联的数据，以及将所述一个或多个瓦片的数据从 内存进入瓦片缓存。 N维数据阵列可以是包括多个像素的二维（2D）数字图像。 2D数字图像的补丁可以指图像的2D子集。