-
1.
公开(公告)号:US10552979B2
公开(公告)日:2020-02-04
申请号:US15703885
申请日:2017-09-13
Applicant: TUSIMPLE
Inventor: Wentao Zhu , Yi Wang , Yi Luo
Abstract: A method of visual odometry for a non-transitory computer readable storage medium storing one or more programs is disclosed. The one or more programs includes instructions, which when executed by a computing device, causes the computing device to perform the following steps comprising: performing data alignment among sensors including a LiDAR, cameras and an IMU-GPS module; collecting image data and generating point clouds; processing, in the IMU-GPS module, a pair of consecutive images in the image data to recognize pixels corresponding to a same point in the point clouds; and establishing an optical flow for visual odometry.
-
公开(公告)号:US10360686B2
公开(公告)日:2019-07-23
申请号:US15621945
申请日:2017-06-13
Applicant: TUSIMPLE
Inventor: Yi Wang , Yi Luo , Wentao Zhu , Panqu Wang
Abstract: A system for generating a ground truth dataset for motion planning of a vehicle is disclosed. The system includes an internet server that further includes an I/O port, configured to transmit and receive electrical signals to and from a client device; a memory; one or more processing units; and one or more programs stored in the memory and configured for execution by the one or more processing units, the one or more programs including instructions for: a corresponding module configured to correspond, for each pair of images, a first image of the pair to a LiDAR static-scene point cloud; and a computing module configured to compute a camera pose associated with the pair of images in the coordinate of the point cloud.
-
3.
公开(公告)号:US10671083B2
公开(公告)日:2020-06-02
申请号:US15703879
申请日:2017-09-13
Applicant: TuSimple, Inc.
Inventor: Wentao Zhu , Yi Wang , Yi Luo
IPC: G05D1/02 , G06K9/46 , G01C21/32 , G06K9/62 , G06T7/246 , G01C21/16 , G01S17/89 , G06N5/02 , G06N20/00 , G06T7/269 , G01C22/00 , G01S17/42 , G01S7/48 , G01S17/86
Abstract: A system for visual odometry is disclosed. The system includes: an internet server, comprising: an I/O port, configured to transmit and receive electrical signals to and from a client device; a memory; one or more processing units; and one or more programs stored in the memory and configured for execution by the one or more processing units, the one or more programs including instructions for: extracting representative features from a pair input images in a first convolution neural network (CNN) in a visual odometry model; merging, in a first merge module, outputs from the first CNN; decreasing feature map size in a second CNN; generating a first flow output for each layer in a first deconvolution neural network (DNN); merging, in a second merge module, outputs from the second CNN and the first DNN; generating a second flow output for each layer in a second DNN; and reducing accumulated errors in a recurrent neural network (RNN).
-
公开(公告)号:US10268205B2
公开(公告)日:2019-04-23
申请号:US15703896
申请日:2017-09-13
Applicant: TUSIMPLE
Inventor: Wentao Zhu , Yi Wang , Yi Luo
Abstract: A method of visual odometry for a non-transitory computer readable storage medium storing one or more programs is disclosed. The one or more programs include instructions, which when executed by a computing device, causes the computing device to perform the following steps comprising: in response to images in pairs, generating a prediction of static scene optical flow for each pair of the images in a visual odometry model; generating a set of motion parameters for each pair of the images in the visual odometry model; training the visual odometry model by using the prediction of static scene optical flow and the motion parameters; and predicting motion between a pair of consecutive image frames by the trained visual odometry model.
-
公开(公告)号:US10481267B2
公开(公告)日:2019-11-19
申请号:US15621918
申请日:2017-06-13
Applicant: TUSIMPLE
Inventor: Yi Wang , Yi Luo , Wentao Zhu , Panqu Wang
Abstract: A method of generating a ground truth dataset for motion planning of a vehicle is disclosed. The method includes: obtaining undistorted LiDAR scans; identifying, for a pair of undistorted LiDAR scans, points belonging to a static object in an environment; aligning the close points based on pose estimates; and transforming a reference scan that is close in time to a target undistorted LiDAR scan so as to align the reference scan with the target undistorted LiDAR scan.
-
-
-
-