SYSTEM AND METHOD FOR MULTITASK PROCESSING FOR AUTONOMOUS VEHICLE COMPUTATION AND CONTROL

    公开(公告)号:US20190101927A1

    公开(公告)日:2019-04-04

    申请号:US15721797

    申请日:2017-09-30

    Applicant: TuSimple

    Abstract: A system and method for multitask processing for autonomous vehicle computation and control are disclosed. A particular embodiment includes: receiving training image data from a training image data collection system; obtaining ground truth data corresponding to the training image data; performing a training phase to train a plurality of tasks associated with features of the training image data, the training phase including extracting common features from the training image data, causing the plurality of tasks to generate task-specific predictions based on the training image data, determining a bias between the task-specific prediction for each task and corresponding task-specific ground truth data, and adjusting parameters of each of the plurality of tasks to cause the bias to meet a pre-defined confidence level; receiving image data from an image data collection system associated with an autonomous vehicle; and performing an operational phase including extracting common features from the image data, causing the plurality of trained tasks to concurrently generate task-specific predictions based on the image data, and output the task-specific predictions to an autonomous vehicle subsystem of the autonomous vehicle.

    SYSTEM AND METHOD FOR OCCLUDING CONTOUR DETECTION

    公开(公告)号:US20190050667A1

    公开(公告)日:2019-02-14

    申请号:US16159060

    申请日:2018-10-12

    Applicant: TuSimple

    Abstract: A system method for occluding contour detection using a fully convolutional neural network is disclosed. A particular embodiment includes: receiving an input image; producing a feature map from the input image by semantic segmentation; learning an array of upscaling filters to upscale the feature map into a final dense feature map of a desired size; applying the array of upscaling filters to the feature map to produce contour information of objects and object instances detected in the input image; and applying the contour information onto the input image.

    SYSTEM AND METHOD FOR FISHEYE IMAGE PROCESSING

    公开(公告)号:US20240311954A1

    公开(公告)日:2024-09-19

    申请号:US18437734

    申请日:2024-02-09

    Applicant: TUSIMPLE, INC.

    CPC classification number: G06T3/047 G05D1/249 G06T5/20 G06T5/80 G06T2207/30252

    Abstract: A system and method for fisheye image processing can be configured to: receive fisheye image data from at least one fisheye lens camera associated with an autonomous vehicle, the fisheye image data representing at least one fisheye image frame; partition the fisheye image frame into a plurality of image portions representing portions of the fisheye image frame; warp each of the plurality of image portions to map an arc of a camera projected view into a line corresponding to a mapped target view, the mapped target view being generally orthogonal to a line between a camera center and a center of the arc of the camera projected view; combine the plurality of warped image portions to form a combined resulting fisheye image data set representing recovered or distortion-reduced fisheye image data corresponding to the fisheye image frame; generate auto-calibration data representing a correspondence between pixels in the at least one fisheye image frame and corresponding pixels in the combined resulting fisheye image data set; and provide the combined resulting fisheye image data set as an output for other autonomous vehicle subsystems.

    IMAGES FOR PERCEPTION MODULES OF AUTONOMOUS VEHICLES

    公开(公告)号:US20210256664A1

    公开(公告)日:2021-08-19

    申请号:US17308911

    申请日:2021-05-05

    Applicant: TUSIMPLE, INC.

    Abstract: Disclosed are devices, systems and methods for processing an image. In one aspect a method includes receiving an image from a sensor array including an x-y array of pixels, each pixel in the x-y array of pixels having a value selected from one of three primary colors, based on a corresponding x-y value in a mask pattern. The method may further include generating a preprocessed image by performing preprocessing on the image. The method may further include performing perception on the preprocessed image to determine one or more outlines of physical objects.

    SYSTEM AND METHOD FOR SEMANTIC SEGMENTATION USING HYBRID DILATED CONVOLUTION (HDC)

    公开(公告)号:US20200265244A1

    公开(公告)日:2020-08-20

    申请号:US16867472

    申请日:2020-05-05

    Applicant: TUSIMPLE, INC.

    Abstract: A system and method for semantic segmentation using hybrid dilated convolution (HDC) are disclosed. A particular embodiment includes: receiving an input image; producing a feature map from the input image; performing a convolution operation on the feature map and producing multiple convolution layers; grouping the multiple convolution layers into a plurality of groups; applying different dilation rates for different convolution layers in a single group of the plurality of groups; and applying a same dilation rate setting across all groups of the plurality of groups.

    SYSTEM AND METHOD FOR IMAGE LOCALIZATION BASED ON SEMANTIC SEGMENTATION

    公开(公告)号:US20200160067A1

    公开(公告)日:2020-05-21

    申请号:US16752632

    申请日:2020-01-25

    Applicant: TuSimple, Inc.

    Abstract: A system and method for image localization based on semantic segmentation are disclosed. A particular embodiment includes: receiving image data from an image generating device mounted on an autonomous vehicle; performing semantic segmentation or other object detection on the received image data to identify and label objects in the image data and produce semantic label image data; identifying extraneous objects in the semantic label image data; removing the extraneous objects from the semantic label image data; comparing the semantic label image data to a baseline semantic label map; and determining a vehicle location of the autonomous vehicle based on information in a matching baseline semantic label map.

    SYSTEM AND METHOD FOR LATERAL VEHICLE DETECTION

    公开(公告)号:US20190286916A1

    公开(公告)日:2019-09-19

    申请号:US15924249

    申请日:2018-03-18

    Applicant: TuSimple

    Abstract: A system and method for lateral vehicle detection is disclosed. A particular embodiment can be configured to: receive lateral image data from at least one laterally-facing camera associated with an autonomous vehicle; warp the lateral image data based on a line parallel to a side of the autonomous vehicle; perform object extraction on the warped lateral image data to identify extracted objects in the warped lateral image data; and apply bounding boxes around the extracted objects.

    SYSTEM AND METHOD FOR ACTIVELY SELECTING AND LABELING IMAGES FOR SEMANTIC SEGMENTATION

    公开(公告)号:US20180365835A1

    公开(公告)日:2018-12-20

    申请号:US15623323

    申请日:2017-06-14

    Applicant: TuSimple

    Abstract: A system and method for actively selecting and labeling images for semantic segmentation are disclosed. A particular embodiment includes: receiving image data from an image generating device; performing semantic segmentation or other object detection on the received image data to identify and label objects in the image data and produce semantic label image data; determining the quality of the semantic label image data based on prediction probabilities associated with regions or portions of the image; and identifying a region or portion of the image for manual labeling if an associated prediction probability is below a pre-determined threshold.

    SYSTEM AND METHOD FOR VEHICLE WHEEL DETECTION

    公开(公告)号:US20180260651A1

    公开(公告)日:2018-09-13

    申请号:US15917331

    申请日:2018-03-09

    Applicant: TuSimple

    Abstract: A system and method for vehicle wheel detection is disclosed. A particular embodiment can be configured to: receive training image data from a training image data collection system; obtain ground truth data corresponding to the training image data; perform a training phase to train one or more classifiers for processing images of the training image data to detect vehicle wheel objects in the images of the training image data; receive operational image data from an image data collection system associated with an autonomous vehicle; and perform an operational phase including applying the trained one or more classifiers to extract vehicle wheel objects from the operational image data and produce vehicle wheel object data.

Patent Agency Ranking