Images for perception modules of autonomous vehicles

    公开(公告)号:US11010874B2

    公开(公告)日:2021-05-18

    申请号:US16381707

    申请日:2019-04-11

    申请人: TuSimple, Inc.

    IPC分类号: G06T5/00 H04N9/04 B60W40/02

    摘要: Disclosed are devices, systems and methods for processing an image. In one aspect a method includes receiving an image from a sensor array including an x-y array of pixels, each pixel in the x-y array of pixels having a value selected from one of three primary colors, based on a corresponding x-y value in a mask pattern. The method may further include generating a preprocessed image by performing preprocessing on the image. The method may further include performing perception on the preprocessed image to determine one or more outlines of physical objects.

    System and method for vehicle occlusion detection

    公开(公告)号:US10783381B2

    公开(公告)日:2020-09-22

    申请号:US16416248

    申请日:2019-05-19

    申请人: TuSimple, Inc.

    摘要: A system and method for vehicle occlusion detection is disclosed. A particular embodiment includes: receiving training image data from a training image data collection system; obtaining ground truth data corresponding to the training image data; performing a training phase to train a plurality of classifiers, a first classifier being trained for processing static images of the training image data, a second classifier being trained for processing image sequences of the training image data; receiving image data from an image data collection system associated with an autonomous vehicle; and performing an operational phase including performing feature extraction on the image data, determining a presence of an extracted feature instance in multiple image frames of the image data by tracing the extracted feature instance back to a previous plurality of N frames relative to a current frame, applying the first trained classifier to the extracted feature instance if the extracted feature instance cannot be determined to be present in multiple image frames of the image data, and applying the second trained classifier to the extracted feature instance if the extracted feature instance can be determined to be present in multiple image frames of the image data.

    SYSTEM AND METHOD FOR LATERAL VEHICLE DETECTION

    公开(公告)号:US20200265243A1

    公开(公告)日:2020-08-20

    申请号:US16865800

    申请日:2020-05-04

    申请人: TUSIMPLE, INC.

    摘要: A system and method for lateral vehicle detection is disclosed. A particular embodiment can be configured to: receive lateral image data from at least one laterally-facing camera associated with an autonomous vehicle; warp the lateral image data based on a line parallel to a side of the autonomous vehicle; perform object extraction on the warped lateral image data to identify extracted objects in the warped lateral image data; and apply bounding boxes around the extracted objects.

    System and method for online real-time multi-object tracking

    公开(公告)号:US10685244B2

    公开(公告)日:2020-06-16

    申请号:US15906561

    申请日:2018-02-27

    申请人: TuSimple, Inc.

    摘要: A system and method for online real-time multi-object tracking is disclosed. A particular embodiment can be configured to: receive image frame data from at least one camera associated with an autonomous vehicle; generate similarity data corresponding to a similarity between object data in a previous image frame compared with object detection results from a current image frame; use the similarity data to generate data association results corresponding to a best matching between the object data in the previous image frame and the object detection results from the current image frame; cause state transitions in finite state machines for each object according to the data association results; and provide as an output object tracking output data corresponding to the states of the finite state machines for each object.

    System and method for vehicle occlusion detection

    公开(公告)号:US11745736B2

    公开(公告)日:2023-09-05

    申请号:US17006283

    申请日:2020-08-28

    申请人: TuSimple, Inc.

    摘要: A system and method for vehicle occlusion detection is disclosed. A particular embodiment includes: receiving training image data from a training image data collection system; obtaining ground truth data corresponding to the training image data; performing a training phase to train a plurality of classifiers, a first classifier being trained for processing static images of the training image data, a second classifier being trained for processing image sequences of the training image data; receiving image data from an image data collection system associated with an autonomous vehicle; and performing an operational phase including performing feature extraction on the image data, determining a presence of an extracted feature instance in multiple image frames of the image data by tracing the extracted feature instance back to a previous plurality of N frames relative to a current frame, applying the first trained classifier to the extracted feature instance if the extracted feature instance cannot be determined to be present in multiple image frames of the image data, and applying the second trained classifier to the extracted feature instance if the extracted feature instance can be determined to be present in multiple image frames of the image data.

    System and method for vehicle wheel detection

    公开(公告)号:US11501513B2

    公开(公告)日:2022-11-15

    申请号:US16855951

    申请日:2020-04-22

    申请人: TUSIMPLE, INC.

    摘要: A system and method for vehicle wheel detection is disclosed. A particular embodiment can be configured to: receive training image data from a training image data collection system; obtain ground truth data corresponding to the training image data; perform a training phase to train one or more classifiers for processing images of the training image data to detect vehicle wheel objects in the images of the training image data; receive operational image data from an image data collection system associated with an autonomous vehicle; and perform an operational phase including applying the trained one or more classifiers to extract vehicle wheel objects from the operational image data and produce vehicle wheel object data.

    System and method for multitask processing for autonomous vehicle computation and control

    公开(公告)号:US10962979B2

    公开(公告)日:2021-03-30

    申请号:US15721797

    申请日:2017-09-30

    申请人: TuSimple, Inc.

    摘要: A system and method for multitask processing for autonomous vehicle computation and control includes: receiving training image data from a training image data collection system; performing a training phase to train a plurality of tasks associated with features of the training image data, the training phase including extracting common features from the training image data, causing the plurality of tasks to generate task-specific predictions based on the training image data, determining a bias between the task-specific prediction for each task and corresponding task-specific ground truth data, and adjusting parameters of each of the plurality of tasks to cause the bias to meet a pre-defined confidence level; receiving image data from an image data collection system associated with an autonomous vehicle; and performing an operational phase including extracting common features from the image data, causing the plurality of trained tasks to concurrently generate task-specific predictions based on the image data.