Training and testing of a neural network method for deep odometry assisted by static scene optical flow

    公开(公告)号:US10268205B2

    公开(公告)日:2019-04-23

    申请号:US15703896

    申请日:2017-09-13

    Applicant: TUSIMPLE

    Abstract: A method of visual odometry for a non-transitory computer readable storage medium storing one or more programs is disclosed. The one or more programs include instructions, which when executed by a computing device, causes the computing device to perform the following steps comprising: in response to images in pairs, generating a prediction of static scene optical flow for each pair of the images in a visual odometry model; generating a set of motion parameters for each pair of the images in the visual odometry model; training the visual odometry model by using the prediction of static scene optical flow and the motion parameters; and predicting motion between a pair of consecutive image frames by the trained visual odometry model.

    Neural network architecture system for deep odometry assisted by static scene optical flow

    公开(公告)号:US10671083B2

    公开(公告)日:2020-06-02

    申请号:US15703879

    申请日:2017-09-13

    Applicant: TuSimple, Inc.

    Abstract: A system for visual odometry is disclosed. The system includes: an internet server, comprising: an I/O port, configured to transmit and receive electrical signals to and from a client device; a memory; one or more processing units; and one or more programs stored in the memory and configured for execution by the one or more processing units, the one or more programs including instructions for: extracting representative features from a pair input images in a first convolution neural network (CNN) in a visual odometry model; merging, in a first merge module, outputs from the first CNN; decreasing feature map size in a second CNN; generating a first flow output for each layer in a first deconvolution neural network (DNN); merging, in a second merge module, outputs from the second CNN and the first DNN; generating a second flow output for each layer in a second DNN; and reducing accumulated errors in a recurrent neural network (RNN).

    Systems and methods for detecting trailer angle

    公开(公告)号:US11200430B2

    公开(公告)日:2021-12-14

    申请号:US16181020

    申请日:2018-11-05

    Applicant: TuSimple, Inc.

    Abstract: Systems and methods for detecting trailer angle are provided. In one aspect, an in-vehicle control system includes an optical sensor configured to be mounted on a tractor so as to face a trailer coupled to the tractor, the optical sensor further configured to generate optical data indicative of an angle formed between the trailer and the tractor. The system further includes a processor and a computer-readable memory in communication with the processor and having stored thereon computer-executable instructions to cause the processor to receive the optical data from the optical sensor, determine at least one candidate plane representative of a surface of the trailer visible in the optical data based on the optical data, and determine an angle between the trailer and the tractor based on the at least one candidate plane.

Patent Agency Ranking