DATA ACQUISTION AND INPUT OF NEURAL NETWORK METHOD FOR DEEP ODOMETRY ASSISTED BY STATIC SCENE OPTICAL FLOW

    公开(公告)号:US20190080166A1

    公开(公告)日:2019-03-14

    申请号:US15703852

    申请日:2017-09-13

    Applicant: TUSIMPLE

    Abstract: A method of visual odometry for a non-transitory computer readable storage medium storing one or more programs is disclosed. The one or more programs comprise instructions, which when executed by a computing device, causes the computing device to perform the following steps comprising: performing data alignment; obtaining data from sensors; based on the data from the sensors, performing machine learning in a visual odometry model; generating a prediction of static optical flow; generating motion parameters; and training the visual odometry model by using at least one of the prediction of static optical flow and the motion parameters.

    TRAINING AND TESTING OF A NEURAL NETWORK SYSTEM FOR DEEP ODOMETRY ASSISTED BY STATIC SCENE OPTICAL FLOW

    公开(公告)号:US20190079536A1

    公开(公告)日:2019-03-14

    申请号:US15703900

    申请日:2017-09-13

    Applicant: TUSIMPLE

    Abstract: A system for visual odometry is provided. The system includes: an internet server, comprising: an I/O port, configured to transmit and receive electrical signals to and from a client device; a memory; one or more processing units; and one or more programs stored in the memory and configured for execution by the one or more processing units, the one or more programs including instructions for: in response to images in pairs, generating a prediction of static scene optical flow for each pair of the images in a visual odometry model; generating a set of motion parameters for each pair of the images in the visual odometry model; training the visual odometry model by using the prediction of static scene optical flow and the motion parameters; and predicting motion between a pair of consecutive image frames by the trained visual odometry model.

    OUTPUT OF A NEURAL NETWORK METHOD FOR DEEP ODOMETRY ASSISTED BY STATIC SCENE OPTICAL FLOW

    公开(公告)号:US20190080470A1

    公开(公告)日:2019-03-14

    申请号:US15703885

    申请日:2017-09-13

    Applicant: TUSIMPLE

    Abstract: A method of visual odometry for a non-transitory computer readable storage medium storing one or more programs is disclosed. The one or more programs includes instructions, which when executed by a computing device, causes the computing device to perform the following steps comprising: performing data alignment among sensors including a LiDAR, cameras and an IMU-GPS module; collecting image data and generating point clouds; processing, in the IMU-GPS module, a pair of consecutive images in the image data to recognize pixels corresponding to a same point in the point clouds; and establishing an optical flow for visual odometry.

    DATA ACQUISTION AND INPUT OF NEURAL NETWORK SYSTEM FOR DEEP ODOMETRY ASSISTED BY STATIC SCENE OPTICAL FLOW

    公开(公告)号:US20190080167A1

    公开(公告)日:2019-03-14

    申请号:US15703863

    申请日:2017-09-13

    Applicant: TUSIMPLE

    Abstract: A system for visual odometry is disclosed. The system includes: an internet server, comprising: an I/O port, configured to transmit and receive electrical signals to and from a client device; a memory; one or more processing units; and one or more programs stored in the memory and configured for execution by the one or more processing units, the one or more programs including instructions for: performing data alignment; obtaining data from sensors; based on the data from the sensors, performing machine learning in a visual odometry model; generating a prediction of static optical flow; generating motion parameters; and training the visual odometry model by using at least one of the prediction of static optical flow and the motion parameters.

    NEURAL NETWORK ARCHITECTURE SYSTEM FOR DEEP ODOMETRY ASSISTED BY STATIC SCENE OPTICAL FLOW

    公开(公告)号:US20190079534A1

    公开(公告)日:2019-03-14

    申请号:US15703879

    申请日:2017-09-13

    Applicant: TUSIMPLE

    Abstract: A system for visual odometry is disclosed. The system includes: an internet server, comprising: an I/O port, configured to transmit and receive electrical signals to and from a client device; a memory; one or more processing units; and one or more programs stored in the memory and configured for execution by the one or more processing units, the one or more programs including instructions for: extracting representative features from a pair input images in a first convolution neural network (CNN) in a visual odometry model; merging, in a first merge module, outputs from the first CNN; decreasing feature map size in a second CNN; generating a first flow output for each layer in a first deconvolution neural network (DNN); merging, in a second merge module, outputs from the second CNN and the first DNN; generating a second flow output for each layer in a second DNN; and reducing accumulated errors in a recurrent neural network (RNN).

    SYSTEM AND METHOD FOR CENTIMETER PRECISION LOCALIZATION USING CAMERA-BASED SUBMAP AND LIDAR-BASED GLOBAL MAP

    公开(公告)号:US20190066329A1

    公开(公告)日:2019-02-28

    申请号:US15684339

    申请日:2017-08-23

    Applicant: TUSIMPLE

    Inventor: YI LUO YI WANG KE XU

    Abstract: A method of localization for a non-transitory computer readable storage medium storing one or more programs is disclosed. The one or more programs comprise instructions, which when executed by a computing device, cause the computing device to perform by one or more autonomous vehicle driving modules execution of processing of images from a camera and data from a LiDAR using the following steps comprising: constructing a 3D submap and a global map; extracting features from the 3D submap and the global map; matching features extracted from the 3D submap against features extracted from the global map; refining feature correspondence; and refining location of the 3D submap.

Patent Agency Ranking