-
公开(公告)号:US11961243B2
公开(公告)日:2024-04-16
申请号:US17187228
申请日:2021-02-26
Applicant: NVIDIA Corporation
Inventor: Dong Zhang , Sangmin Oh , Junghyun Kwon , Baris Evrim Demiroz , Tae Eun Choe , Minwoo Park , Chethan Ningaraju , Hao Tsui , Eric Viscito , Jagadeesh Sankaran , Yongqing Liang
IPC: G06T7/00 , B60W60/00 , G06F18/214 , G06N3/08 , G06T7/246 , G06V10/25 , G06V10/75 , G06V20/58 , G06V20/56
CPC classification number: G06T7/246 , B60W60/001 , G06F18/2148 , G06N3/08 , G06V10/25 , G06V10/751 , G06V20/58 , G06V20/56
Abstract: A geometric approach may be used to detect objects on a road surface. A set of points within a region of interest between a first frame and a second frame are captured and tracked to determine a difference in location between the set of points in two frames. The first frame may be aligned with the second frame and the first pixel values of the first frame may be compared with the second pixel values of the second frame to generate a disparity image including third pixels. One or more subsets of the third pixels that have a value above a first threshold may be combined, and the third pixels may be scored and associated with disparity values for each pixel of the one or more subsets of the third pixels. A bounding shape may be generated based on the scoring.
-
公开(公告)号:US20220398751A1
公开(公告)日:2022-12-15
申请号:US17377244
申请日:2021-07-15
Applicant: NVIDIA Corporation
Inventor: Vipul Parashar , Dong Zhang , Sampurnananda Mishra
IPC: G06T7/269
Abstract: Apparatuses, systems, and techniques to calculate motion of one or more pixel in a region in an image. In at least one embodiment, motion is calculated based on motion of one or more pixels in a different region of said image that overlaps said region in which one or more algorithms are expressed in CUDA code, for example, for efficient execution on a GPU.
-
公开(公告)号:US20220076429A1
公开(公告)日:2022-03-10
申请号:US17526750
申请日:2021-11-15
Applicant: NVIDIA Corporation
Inventor: Dong Zhang , Jianjun Chen , Manindra Parhy
Abstract: In various examples, optical flow estimate (OFE) quality is improved when employing a hint-based algorithm in multi-level hierarchical motion estimation by using different scan orders at different resolution levels. A scan of an image performed with a scan order may initially leverage OFEs from a previous scan of the image, where the previous scan was performed using a different scan order. The OFEs leveraged from the previous scan are more likely to be of high accuracy until sufficient spatial hints are available to the hint-based algorithm for the scan to reduce the impact of potentially lower quality OFEs resulting from the different scan order of the previous scan.
-
公开(公告)号:US11176682B2
公开(公告)日:2021-11-16
申请号:US16698021
申请日:2019-11-27
Applicant: NVIDIA Corporation
Inventor: Dong Zhang , Jianjun Chen , Manindra Parhy
Abstract: In various examples, optical flow estimate (OFE) quality is improved when employing a hint-based algorithm in multi-level hierarchical motion estimation by using different scan orders at different resolution levels. A scan of an image performed with a scan order may initially leverage OFEs from a previous scan of the image, where the previous scan was performed using a different scan order. The OFEs leveraged from the previous scan are more likely to be of high accuracy until sufficient spatial hints are available to the hint-based algorithm for the scan to reduce the impact of potentially lower quality OFEs resulting from the different scan order of the previous scan.
-
公开(公告)号:US12235353B2
公开(公告)日:2025-02-25
申请号:US17454389
申请日:2021-11-10
Applicant: NVIDIA Corporation
Inventor: Gang Pan , Joachim Pehserl , Dong Zhang , Baris Evrim Demiroz , Samuel Rupp Ogden , Tae Eun Choe , Sangmin Oh
IPC: G01S13/931 , G01S13/86 , G01S17/86 , G01S17/931
Abstract: In various examples, a hazard detection system fuses outputs from multiple sensors over time to determine a probability that a stationary object or hazard exists at a location. The system may then use sensor data to calculate a detection bounding shape for detected objects and, using the bounding shape, may generate a set of particles, each including a confidence value that an object exists at a corresponding location. The system may then capture additional sensor data by one or more sensors of the ego-machine that are different from those used to capture the first sensor data. To improve the accuracy of the confidences of the particles, the system may determine a correspondence between the first sensor data and the additional sensor data (e.g., depth sensor data), which may be used to filter out a portion of the particles and improve the depth predictions corresponding to the object.
-
公开(公告)号:US11941873B2
公开(公告)日:2024-03-26
申请号:US18054288
申请日:2022-11-10
Applicant: NVIDIA Corporation
Inventor: Mansi Rankawat , Jian Yao , Dong Zhang , Chia-Chih Chen
IPC: G06V10/82 , G05D1/00 , G06F18/2413 , G06N3/08 , G06T7/11 , G06V20/58 , G06V30/19 , G06V30/194 , G06V20/56
CPC classification number: G06V10/82 , G05D1/0088 , G05D1/0246 , G06F18/24143 , G06N3/08 , G06T7/11 , G06V20/58 , G06V30/19173 , G06V30/194 , G05D2201/0213 , G06T2207/30252 , G06V20/588
Abstract: In various examples, sensor data may be received that represents a field of view of a sensor of a vehicle located in a physical environment. The sensor data may be applied to a machine learning model that computes both a set of boundary points that correspond to a boundary dividing drivable free-space from non-drivable space in the physical environment and class labels for boundary points of the set of boundary points that correspond to the boundary. Locations within the physical environment may be determined from the set of boundary points represented by the sensor data, and the vehicle may be controlled through the physical environment within the drivable free-space using the locations and the class labels.
-
7.
公开(公告)号:US20230281830A1
公开(公告)日:2023-09-07
申请号:US17834522
申请日:2022-06-07
Applicant: NVIDIA Corporation
Inventor: Dong Zhang , Xi He
CPC classification number: G06T7/215 , G06T3/4069
Abstract: Disclosed are apparatuses, systems, and techniques that may perform methods of pyramid optical flow processing with efficient identification and handling of object boundary pixels. In pyramid optical flow, motion vectors for pixels of image layers having a coarse resolution may be used as hints for identification of motion vectors for pixels of image layers having a higher resolution. Pixels that are located near apparent boundaries between foreground and background objects may receive multiple hints from lower-resolution image layers, for more accurate identification of matching pixels across different image levels of the pyramid.
-
公开(公告)号:US20230130478A1
公开(公告)日:2023-04-27
申请号:US17798232
申请日:2020-06-22
Applicant: Nvidia Corporation
Inventor: Dong Zhang , Eric Viscito , Frans Sijstermans , Jagadeesh Sankaran , Ching Hung , Yen-Te Shih , Ravi Singh
IPC: G06T7/593
Abstract: A hybrid matching approach can be used for computer vision that balances accuracy with speed and resource consumption. Stereoscopic image data can be rectified and downsampled, then analyzed using a semi-global matching (SGM) process. The use of downsampled images greatly reduces time and bandwidth requirements, while providing high accuracy disparity results. These disparity results can be provided as external hints to a fast module that can perform a robust matching process in the time needed for applications such as real time navigation. The external hints can be used, along with potentially other hints, to define a search space for use by the fast module, which can result in higher quality disparity results obtained within specified timing constraints and with limited resources. The disparity results can be used to determine distances to various objects, as may be important for vehicle navigation or robotic task performance.
-
公开(公告)号:US20210264175A1
公开(公告)日:2021-08-26
申请号:US17187228
申请日:2021-02-26
Applicant: NVIDIA Corporation
Inventor: Dong Zhang , Sangmin Oh , Junghyun Kwon , Baris Evrim Demiroz , Tae Eun Choe , Minwoo Park , Chethan Ningaraju , Hao Tsui , Eric Viscito , Jagadeesh Sankaran , Yongqing Liang
Abstract: Systems and methods are disclosed that use a geometric approach to detect objects on a road surface. A set of points within a region of interest between a first frame and a second frame are captured and tracked to determine a difference in location between the set of points in two frames. The first frame may be aligned with the second frame and the first pixel values of the first frame may be compared with the second pixel values of the second frame to generate a disparity image including third pixels. One or more subsets of the third pixels that have an disparity image value about a first threshold may be combined, and the third pixels may be scored and associated with disparity values for each pixel of the one or more subsets of the third pixels. A bounding shape may be generated based on the scoring that corresponds to the object.
-
公开(公告)号:US20190286153A1
公开(公告)日:2019-09-19
申请号:US16355328
申请日:2019-03-15
Applicant: NVIDIA Corporation
Inventor: Mansi Rankawat , Jian Yao , Dong Zhang , Chia-Chih Chen
Abstract: In various examples, sensor data may be received that represents a field of view of a sensor of a vehicle located in a physical environment. The sensor data may be applied to a machine learning model that computes both a set of boundary points that correspond to a boundary dividing drivable free-space from non-drivable space in the physical environment and class labels for boundary points of the set of boundary points that correspond to the boundary. Locations within the physical environment may be determined from the set of boundary points represented by the sensor data, and the vehicle may be controlled through the physical environment within the drivable free-space using the locations and the class labels.
-
-
-
-
-
-
-
-
-