公开(公告)号：US20240265555A1

公开(公告)日：2024-08-08

申请号：US18614160

申请日：2024-03-22

Applicant: NVIDIA Corporation

Inventor： Dong Zhang ,  Sangmin Oh ,  Junghyun Kwon ,  Baris Evrim Demiroz ,  Tae Eun Choe ,  Minwoo Park ,  Chethan Ningaraju ,  Hao Tsui ,  Eric Viscito ,  Jagadeesh Sankaran ,  Yongqing Liang

IPC: G06T7/246 ,  B60W60/00 ,  G06F18/214 ,  G06N3/08 ,  G06V10/25 ,  G06V10/75 ,  G06V20/56 ,  G06V20/58

CPC classification number: G06T7/246 ,  B60W60/001 ,  G06F18/2148 ,  G06N3/08 ,  G06V10/25 ,  G06V10/751 ,  G06V20/58 ,  G06V20/56

Abstract: Systems and methods are disclosed that use a geometric approach to detect objects on a road surface. A set of points within a region of interest between a first frame and a second frame are captured and tracked to determine a difference in location between the set of points in two frames. The first frame may be aligned with the second frame and the first pixel values of the first frame may be compared with the second pixel values of the second frame to generate a disparity image including third pixels. Subsets of the third pixels that have an disparity image value about a first threshold may be combined, and the third pixels may be scored and associated with disparity values for each pixel of the one or more subsets of the third pixels. A bounding shape may be generated based on the scoring that corresponds to the object.

公开(公告)号：US20170195591A1

公开(公告)日：2017-07-06

申请号：US14988630

申请日：2016-01-05

Applicant: Nvidia Corporation

Inventor： Niranjan Avadhanam ,  Eric Viscito ,  Varun Allagadapa ,  Thrinadh Kottana

IPC: H04N5/357 ,  H04N5/374 ,  H04N5/232

CPC classification number: H04N5/357 ,  H04B1/3833 ,  H04N5/23254 ,  H04N5/23267 ,  H04N5/374

Abstract: Embodiments of the present invention are directed to methods and systems for performing automatic noise reduction in video. According to one aspect of the invention, a video noise-reducing system is provided consisting of a noise estimator, a motion classifier, two stages of filters, each including a spatial and temporal filter, and a combiner. The system adapts to noise level and to scene content to find at each location in the image a balance of noise reduction and detail preservation. Temporal Infinite Impulse Response (IIR) filtering provides a high level of detail-preserving noise reduction where motion allows, while non linear spatial filtering provides edge-preserving noise reduction in areas where the temporal filter would introduce motion artifacts. A spatial-temporal combiner provides smooth transition and balance between the two filtering modes; this block also enables use of external cues to produce a visually pleasing output based on ambient conditions.

公开(公告)号：US20240119701A1

公开(公告)日：2024-04-11

申请号：US17955841

申请日：2022-09-29

Applicant: NVIDIA Corporation

Inventor： Zoran Nikolic ,  Eric Viscito

IPC: G06V10/75 ,  G06V10/62 ,  G06V20/56

CPC classification number: G06V10/751 ,  G06V10/62 ,  G06V20/56

Abstract: In various examples, techniques for using hardware feature trackers in autonomous or semi-autonomous systems are described. Systems and methods are disclosed that use a processor(s) to determine flow vectors associated with pixel locations in a first image. The systems also use the processor(s) to determine a location of a feature point in a second image based at least on one or more of the flow vectors and a subpixel location of the feature point in the first image. In some examples, the processor(s) may include an optical flow accelerator (OFA) that includes a hardware unit storing a lookup table that is used to determine the location of the feature point in the second image. In some examples, the processor(s) may include an OFA to determine the flow vectors and a vision processor to determine the location of the feature point in the second image.

公开(公告)号：US20220237414A1

公开(公告)日：2022-07-28

申请号：US17158743

申请日：2021-01-26

Applicant: NVIDIA Corporation

Inventor： Eric Kangning Zhang ,  Zoran Nikolic ,  Branislav Kisacanin ,  Eric Viscito

IPC: G06K9/62 ,  G06K9/00 ,  B60W60/00 ,  B60W10/18 ,  B60W10/04 ,  B60W50/14 ,  B60W30/095 ,  B60W30/09 ,  A01B69/00 ,  A01C21/00 ,  A01G25/09 ,  A01G25/16 ,  A01M21/00 ,  G16H40/67 ,  G06N3/08 ,  G06N3/04

Abstract: Apparatuses, systems, and techniques to generate one or more confidence values associated with one or more objects identified by one or more neural networks. In at least one embodiment, one or more confidence values associated with one or more objects identified by one or more neural networks are generated based on, for example, one or more neural network outputs.

公开(公告)号：US11961243B2

公开(公告)日：2024-04-16

申请号：US17187228

申请日：2021-02-26

Applicant: NVIDIA Corporation

Inventor： Dong Zhang ,  Sangmin Oh ,  Junghyun Kwon ,  Baris Evrim Demiroz ,  Tae Eun Choe ,  Minwoo Park ,  Chethan Ningaraju ,  Hao Tsui ,  Eric Viscito ,  Jagadeesh Sankaran ,  Yongqing Liang

IPC: G06T7/00 ,  B60W60/00 ,  G06F18/214 ,  G06N3/08 ,  G06T7/246 ,  G06V10/25 ,  G06V10/75 ,  G06V20/58 ,  G06V20/56

CPC classification number: G06T7/246 ,  B60W60/001 ,  G06F18/2148 ,  G06N3/08 ,  G06V10/25 ,  G06V10/751 ,  G06V20/58 ,  G06V20/56

Abstract: A geometric approach may be used to detect objects on a road surface. A set of points within a region of interest between a first frame and a second frame are captured and tracked to determine a difference in location between the set of points in two frames. The first frame may be aligned with the second frame and the first pixel values of the first frame may be compared with the second pixel values of the second frame to generate a disparity image including third pixels. One or more subsets of the third pixels that have a value above a first threshold may be combined, and the third pixels may be scored and associated with disparity values for each pixel of the one or more subsets of the third pixels. A bounding shape may be generated based on the scoring.

公开(公告)号：US10257449B2

公开(公告)日：2019-04-09

申请号：US14988630

申请日：2016-01-05

Applicant: Nvidia Corporation

Inventor： Niranjan Avadhanam ,  Eric Viscito ,  Varun Allagadapa ,  Thrinadh Kottana

IPC: H04N5/232 ,  H04N5/357 ,  H04N5/374 ,  H04B1/3827

Abstract: Embodiments of the present invention are directed to methods and systems for performing automatic noise reduction in video. According to one aspect of the invention, a video noise-reducing system is provided consisting of a noise estimator, a motion classifier, two stages of filters, each including a spatial and temporal filter, and a combiner. The system adapts to noise level and to scene content to find at each location in the image a balance of noise reduction and detail preservation. Temporal Infinite Impulse Response (IIR) filtering provides a high level of detail-preserving noise reduction where motion allows, while non linear spatial filtering provides edge-preserving noise reduction in areas where the temporal filter would introduce motion artifacts. A spatial-temporal combiner provides smooth transition and balance between the two filtering modes; this block also enables use of external cues to produce a visually pleasing output based on ambient conditions.

公开(公告)号：US20230130478A1

公开(公告)日：2023-04-27

申请号：US17798232

申请日：2020-06-22

Applicant: Nvidia Corporation

Inventor： Dong Zhang ,  Eric Viscito ,  Frans Sijstermans ,  Jagadeesh Sankaran ,  Ching Hung ,  Yen-Te Shih ,  Ravi Singh

IPC: G06T7/593

Abstract: A hybrid matching approach can be used for computer vision that balances accuracy with speed and resource consumption. Stereoscopic image data can be rectified and downsampled, then analyzed using a semi-global matching (SGM) process. The use of downsampled images greatly reduces time and bandwidth requirements, while providing high accuracy disparity results. These disparity results can be provided as external hints to a fast module that can perform a robust matching process in the time needed for applications such as real time navigation. The external hints can be used, along with potentially other hints, to define a search space for use by the fast module, which can result in higher quality disparity results obtained within specified timing constraints and with limited resources. The disparity results can be used to determine distances to various objects, as may be important for vehicle navigation or robotic task performance.

公开(公告)号：US20210264175A1

公开(公告)日：2021-08-26

申请号：US17187228

申请日：2021-02-26

Applicant: NVIDIA Corporation

Inventor： Dong Zhang ,  Sangmin Oh ,  Junghyun Kwon ,  Baris Evrim Demiroz ,  Tae Eun Choe ,  Minwoo Park ,  Chethan Ningaraju ,  Hao Tsui ,  Eric Viscito ,  Jagadeesh Sankaran ,  Yongqing Liang

IPC: G06K9/00 ,  G06K9/62 ,  G06K9/32 ,  G06N3/08 ,  B60W60/00

Abstract: Systems and methods are disclosed that use a geometric approach to detect objects on a road surface. A set of points within a region of interest between a first frame and a second frame are captured and tracked to determine a difference in location between the set of points in two frames. The first frame may be aligned with the second frame and the first pixel values of the first frame may be compared with the second pixel values of the second frame to generate a disparity image including third pixels. One or more subsets of the third pixels that have an disparity image value about a first threshold may be combined, and the third pixels may be scored and associated with disparity values for each pixel of the one or more subsets of the third pixels. A bounding shape may be generated based on the scoring that corresponds to the object.