Invention Grant
- Patent Title: Joint 3D object detection and orientation estimation via multimodal fusion
-
Application No.: US16326141Application Date: 2018-03-16
-
Publication No.: US10885398B2Publication Date: 2021-01-05
- Inventor: Chien-Yi Wang , Athmanarayanan Lakshmi Narayanan , Yi-Ting Chen
- Applicant: Chien-Yi Wang , Athmanarayanan Lakshmi Narayanan , Yi-Ting Chen
- Applicant Address: US CA Sunnyvale; US CA Sunnyvale; US CA Sunnyvale
- Assignee: Chien-Yi Wang,Athmanarayanan Lakshmi Narayanan,Yi-Ting Chen
- Current Assignee: Chien-Yi Wang,Athmanarayanan Lakshmi Narayanan,Yi-Ting Chen
- Current Assignee Address: US CA Sunnyvale; US CA Sunnyvale; US CA Sunnyvale
- Agency: Arent Fox LLP
- International Application: PCT/US2018/022995 WO 20180316
- International Announcement: WO2018/170472 WO 20180920
- Main IPC: G06K9/62
- IPC: G06K9/62 ; G06K9/00 ; G01C3/08 ; G06N3/04 ; G01S7/48 ; G01S17/42 ; G06K9/66

Abstract:
The present disclosure generally relates to methods and systems for identifying objects from a 3D point cloud and a 2D image. The method may include determining a first set of 3D proposals using Euclidean clustering on the 3D point cloud and determining a second set of 3D proposals from the 3D point cloud based on a 3D convolutional neural network. The method may include pooling the first and second sets of 3D proposals to determine a set of 3D candidates. The method may include projecting the first set of 3D proposals onto the 2D image and determining a first set of 2D proposals using 2D convolutional neural network. The method may include pooling the projected first set of 3D proposals and the first set of 2D proposals to determine a set of 2D candidates then pooling the set of 3D candidates and the set of 2D candidates.
Public/Granted literature
- US20190188541A1 JOINT 3D OBJECT DETECTION AND ORIENTATION ESTIMATION VIA MULTIMODAL FUSION Public/Granted day:2019-06-20
Information query