- Patent Title: Distance to obstacle detection in autonomous machine applications
-
Application No.: US17522624Application Date: 2021-11-09
-
Publication No.: US11704890B2Publication Date: 2023-07-18
- Inventor: Yilin Yang , Bala Siva Jujjavarapu , Pekka Janis , Zhaoting Ye , Sangmin Oh , Minwoo Park , Daniel Herrera Castro , Tommi Koivisto , David Nister
- Applicant: NVIDIA Corporation
- Applicant Address: US CA Santa Clara
- Assignee: NVIDIA Corporation
- Current Assignee: NVIDIA Corporation
- Current Assignee Address: US CA Santa Clara
- Agency: Taylor English Duma L.L.P.
- Main IPC: G06K9/00
- IPC: G06K9/00 ; G06V10/25 ; G06T7/536 ; G06V20/58 ; G06V10/70 ; G06V10/82 ; G06V10/44

Abstract:
In various examples, a deep neural network (DNN) is trained—using image data alone—to accurately predict distances to objects, obstacles, and/or a detected free-space boundary. The DNN may be trained with ground truth data that is generated using sensor data representative of motion of an ego-vehicle and/or sensor data from any number of depth predicting sensors—such as, without limitation, RADAR sensors, LIDAR sensors, and/or SONAR sensors. The DNN may be trained using two or more loss functions each corresponding to a particular portion of the environment that depth is predicted for, such that—in deployment—more accurate depth estimates for objects, obstacles, and/or the detected free-space boundary are computed by the DNN. In some embodiments, a sampling algorithm may be used to sample depth values corresponding to an input resolution of the DNN from a predicted depth map of the DNN at an output resolution of the DNN.
Public/Granted literature
- US20220108465A1 DISTANCE TO OBSTACLE DETECTION IN AUTONOMOUS MACHINE APPLICATIONS Public/Granted day:2022-04-07
Information query