-
公开(公告)号:US12031824B2
公开(公告)日:2024-07-09
申请号:US17664653
申请日:2022-05-23
申请人: NVIDIA Corporation
发明人: Mark Damon Wheeler , Gregory William Coombe , Di Zeng , Jeff Adachi , Chen Chen
CPC分类号: G01C21/165 , G01C21/1652 , G01C21/1656 , G01C21/3848 , G01S19/393 , G01S19/46 , G01S19/47 , G01S19/52 , G05D1/0231 , G05D1/0255 , G05D1/0257 , G05D1/027 , G05D1/0278 , G01C21/1654
摘要: A vehicle computing system validates location data received from a Global Navigation Satellite System receiver with other sensor data. In one embodiment, the system calculates velocities with the location data and the other sensor data. The system generates a probabilistic model for velocity with a velocity calculated with location data and variance associated with the location data. The system determines a confidence score by applying the probabilistic model to one or more of the velocities calculated with other sensor data. In another embodiment, the system implements a machine learning model that considers features extracted from the sensor data. The system generates a feature vector for the location data and determines a confidence score for the location data by applying the machine learning model to the feature vector. Based on the confidence score, the system can validate the location data. The validated location data is useful for navigation and map updates.
-
公开(公告)号:US11842528B2
公开(公告)日:2023-12-12
申请号:US17079057
申请日:2020-10-23
申请人: NVIDIA CORPORATION
发明人: Mark Damon Wheeler , Xiaqing Wu
IPC分类号: B60W30/00 , G06V10/764 , G06F16/29 , H04L67/10 , H04L69/40 , G01C21/00 , G06V10/98 , G06V20/56 , G06V20/64 , H04L67/52 , G06F18/22 , G06F18/24 , G06V10/75 , G01C21/36 , G05D1/00 , G06T17/05 , B60W30/095 , B60W40/02 , G01C21/30 , G05D1/02 , H04L67/12 , G06V20/58 , H04L67/53
CPC分类号: G06V10/764 , B60W30/0956 , B60W40/02 , G01C21/30 , G01C21/3635 , G01C21/3841 , G01C21/3848 , G01C21/3867 , G05D1/0088 , G05D1/0214 , G05D1/0274 , G06F16/29 , G06F18/22 , G06F18/24 , G06T17/05 , G06V10/75 , G06V10/98 , G06V20/56 , G06V20/64 , H04L67/10 , H04L67/12 , H04L67/52 , H04L69/40 , B60W2554/00 , B60W2556/50 , G05D2201/0213 , G06V20/58 , H04L67/53
摘要: An online system builds a high definition (HD) map for a geographical region based on sensor data captured by a plurality of autonomous vehicles driving through a geographical region. The autonomous vehicles detect map discrepancies based on differences in the surroundings observed using sensor data compared to the high definition map and send messages describing these map discrepancies to the online system. The online system updates existing occupancy maps to improve the accuracy of the occupancy maps (OMaps), and to thereby improve passenger and pedestrian safety. While vehicles are in motion, they can continuously collect data about their surroundings. When new data is available from the various vehicles within a fleet, this can be updated in a local representation of the occupancy map and can be passed to the online HD map system (e.g., in the cloud) for updating the master occupancy map shared by all of the vehicles.
-
公开(公告)号:US11566903B2
公开(公告)日:2023-01-31
申请号:US16290480
申请日:2019-03-01
申请人: NVIDIA CORPORATION
发明人: Gil Colgate , Mark Damon Wheeler , Wei Luo
IPC分类号: G01C21/36 , G05D1/00 , G06T7/70 , G06T11/60 , G05D1/02 , G01C21/32 , G01C21/34 , G06V20/40 , G06V20/56 , G06V30/262
摘要: The autonomous vehicle generates an overlapped image by overlaying HD map data over sensor data and rendering the overlaid images. The visualization process is repeated as the vehicle drives along the route. The visualization may be displayed on a screen within the vehicle or at a remote device. The system performs reverse rendering of a scene based on map data from a selected point. For each line of sight originating at the selected point, the system identifies the farthest object in the map data. Accordingly, the system eliminates objects obstructing the view of the farthest objects in the HD map as viewed from the selected point. The system further allows filtering of objects using filtering criteria based on semantic labels. The system generates a view from the selected point such that 3D objects matching the filtering criteria are eliminated from the view.
-
公开(公告)号:US12046006B2
公开(公告)日:2024-07-23
申请号:US16920128
申请日:2020-07-02
申请人: NVIDIA CORPORATION
发明人: Zhengyu Zhang , Lin Yang , Mark Damon Wheeler
IPC分类号: G01C3/08 , B60W60/00 , G01S7/481 , G01S7/497 , G01S17/10 , G01S17/89 , G01S17/894 , G01S17/931 , G06T7/73 , G06T7/80 , G06V10/44 , G06V10/75 , G06V20/56 , G05D1/00
CPC分类号: G06T7/80 , B60W60/00 , G01S7/4814 , G01S7/4817 , G01S7/497 , G01S17/10 , G01S17/89 , G01S17/894 , G01S17/931 , G06T7/74 , G06V10/44 , G06V10/751 , G06V20/56 , B60W2420/403 , B60W2420/408 , G05D1/0231
摘要: According to an aspect of an embodiment, operations may comprise receiving a LIDAR scan of a scene from a LIDAR of a vehicle with the scene comprising a board, detecting the board in the LIDAR scan, fitting a plane through LIDAR coordinates corresponding to the detected board, projecting the plane from the LIDAR coordinates to a first set of camera coordinates, detecting the board in a camera image from a camera of the vehicle at a second set of camera coordinates, and calibrating the LIDAR of the vehicle and the camera of the vehicle by determining a transform between the first set of camera coordinates and the second set of camera coordinates.
-
公开(公告)号:US20220373687A1
公开(公告)日:2022-11-24
申请号:US17646293
申请日:2021-12-28
申请人: NVIDIA Corporation
发明人: Lin Yang , Mark Damon Wheeler
IPC分类号: G01S17/89 , H04N19/17 , G01C21/30 , G06T9/00 , G01S17/86 , G01S17/90 , G01S17/931 , G06V20/58 , G06V20/56 , G01C21/32 , G06T9/20
摘要: Embodiments relate to methods for efficiently encoding sensor data captured by an autonomous vehicle and building a high definition map using the encoded sensor data. The sensor data can be LiDAR data which is expressed as multiple image representations. Image representations that include important LiDAR data undergo a lossless compression while image representations that include LiDAR data that is more error-tolerant undergo a lossy compression. Therefore, the compressed sensor data can be transmitted to an online system for building a high definition map. When building a high definition map, entities, such as road signs and road lines, are constructed such that when encoded and compressed, the high definition map consumes less storage space. The positions of entities are expressed in relation to a reference centerline in the high definition map. Therefore, each position of an entity can be expressed in fewer numerical digits in comparison to conventional methods.
-
公开(公告)号:US11482008B2
公开(公告)日:2022-10-25
申请号:US16920105
申请日:2020-07-02
申请人: NVIDIA CORPORATION
发明人: Ziqiang Huang , Lin Yang , Mark Damon Wheeler
IPC分类号: B60W60/00 , G06T7/73 , G06V20/56 , G01S17/931 , G01S7/481 , G01S7/497 , G01S17/10 , G01S17/89 , G01S17/894 , G06V10/75 , G05D1/02
摘要: According to an aspect of an embodiment, operations may comprise determining a target position and orientation for a calibration board with respect to a camera of a vehicle, detecting a first position and orientation of the calibration board with respect to the camera of the vehicle, determining instructions for moving the calibration board from the first position and orientation to the target position and orientation, transmitting the instructions to a device, detecting a second position and orientation of the calibration board, determining whether the second position and orientation is within a threshold of matching the target position and orientation, and, in response to determining that the second position and orientation is within the threshold of matching the target position and orientation, capturing one or more calibration camera images using the camera and calibrating one or more sensors of the vehicle using the one or more calibration camera images.
-
公开(公告)号:US11754716B2
公开(公告)日:2023-09-12
申请号:US17646293
申请日:2021-12-28
申请人: NVIDIA Corporation
发明人: Lin Yang , Mark Damon Wheeler
IPC分类号: G01S17/89 , H04N19/17 , G01C21/30 , G06T9/00 , G01S17/86 , G01S17/90 , G01S17/931 , G06V20/58 , G06V20/56 , G01C21/00 , G06T9/20 , G05D1/02 , G06F16/174 , B60R11/04 , G01C11/02
CPC分类号: G01S17/89 , G01C21/30 , G01C21/3841 , G01C21/3848 , G01C21/3867 , G01S17/86 , G01S17/90 , G01S17/931 , G06T9/001 , G06T9/20 , G06V20/582 , G06V20/584 , G06V20/588 , H04N19/17 , B60R11/04 , G01C11/025 , G05D1/0274 , G05D2201/0213 , G06F16/1744
摘要: Embodiments relate to methods for efficiently encoding sensor data captured by an autonomous vehicle and building a high definition map using the encoded sensor data. The sensor data can be LiDAR data which is expressed as multiple image representations. Image representations that include important LiDAR data undergo a lossless compression while image representations that include LiDAR data that is more error-tolerant undergo a lossy compression. Therefore, the compressed sensor data can be transmitted to an online system for building a high definition map. When building a high definition map, entities, such as road signs and road lines, are constructed such that when encoded and compressed, the high definition map consumes less storage space. The positions of entities are expressed in relation to a reference centerline in the high definition map. Therefore, each position of an entity can be expressed in fewer numerical digits in comparison to conventional methods.
-
公开(公告)号:US11747455B2
公开(公告)日:2023-09-05
申请号:US17809526
申请日:2022-06-28
申请人: NVIDIA Corporation
发明人: Mark Damon Wheeler , Lin Yang
IPC分类号: G01S7/497 , G01S17/87 , G01S17/86 , G01S17/931 , G01C21/16 , H04N23/68 , H04N23/60 , G01S17/89 , G05D1/02 , G06T7/80 , G06T7/13 , G01S17/42 , G01S7/481 , G05D1/00 , G06T7/55 , G06T7/33 , G01C21/36 , H04N5/04 , H04N13/106 , G06V20/56 , H04N23/54 , H04N23/90 , B60R1/00
CPC分类号: G01S7/497 , G01C21/1652 , G01C21/3602 , G01S7/4817 , G01S7/4972 , G01S17/42 , G01S17/86 , G01S17/87 , G01S17/89 , G01S17/931 , G05D1/0088 , G05D1/0231 , G05D1/0248 , G06T7/13 , G06T7/33 , G06T7/55 , G06T7/80 , H04N5/04 , H04N13/106 , H04N23/60 , H04N23/689 , B60R1/00 , G05D1/0287 , G05D2201/0213 , G06T2207/10028 , G06T2207/10048 , G06T2207/20092 , G06T2207/20221 , G06T2207/30241 , G06T2207/30242 , G06T2207/30252 , G06V20/56 , H04N23/54 , H04N23/90
摘要: A system calibrates one or more sensors mounted to an autonomous vehicle. From the one or more sensors, the system identifies a primary sensor and a secondary sensor. The system determines a reference angle for the primary sensor, and based on that reference angle for the primary sensor, a scan-start time representing a start of a scan and a scan-end time representing an end of a scan. The system receives, from the primary sensor, a primary set of scan data recorded from the scan-start time to the scan-end time. The system receives, from the secondary sensor, a secondary set of sensor data recorded from the scan-start time to the scan-end time. The system calibrates the primary and secondary sensors by determining a relative transform for transforming points between the first set of scan data and the second set of scan data.
-
公开(公告)号:US20230031260A1
公开(公告)日:2023-02-02
申请号:US17664653
申请日:2022-05-23
申请人: NVIDIA Corporation
发明人: Mark Damon Wheeler , Gregory William Coombe , Di Zeng , Jeff Adachi , Chen Chen
摘要: A vehicle computing system validates location data received from a Global Navigation Satellite System receiver with other sensor data. In one embodiment, the system calculates velocities with the location data and the other sensor data. The system generates a probabilistic model for velocity with a velocity calculated with location data and variance associated with the location data. The system determines a confidence score by applying the probabilistic model to one or more of the velocities calculated with other sensor data. In another embodiment, the system implements a machine learning model that considers features extracted from the sensor data. The system generates a feature vector for the location data and determines a confidence score for the location data by applying the machine learning model to the feature vector. Based on the confidence score, the system can validate the location data. The validated location data is useful for navigation and map updates.
-
公开(公告)号:US20220329715A1
公开(公告)日:2022-10-13
申请号:US17809526
申请日:2022-06-28
申请人: NVIDIA Corporation
发明人: Mark Damon Wheeler , Lin Yang
IPC分类号: H04N5/232 , G01S17/87 , G01S17/86 , G01S17/931 , G01S7/497 , G01S17/89 , G05D1/02 , G06T7/80 , G06T7/13 , G01S17/42 , G01S7/481 , G05D1/00 , G06T7/55 , G06T7/33 , G01C21/36 , H04N5/04 , H04N13/106
摘要: A system calibrates one or more sensors mounted to an autonomous vehicle. From the one or more sensors, the system identifies a primary sensor and a secondary sensor. The system determines a reference angle for the primary sensor, and based on that reference angle for the primary sensor, a scan-start time representing a start of a scan and a scan-end time representing an end of a scan. The system receives, from the primary sensor, a primary set of scan data recorded from the scan-start time to the scan-end time. The system receives, from the secondary sensor, a secondary set of sensor data recorded from the scan-start time to the scan-end time. The system calibrates the primary and secondary sensors by determining a relative transform for transforming points between the first set of scan data and the second set of scan data.
-
-
-
-
-
-
-
-
-