SYSTEM AND METHOD FOR FISHEYE IMAGE PROCESSING

    公开(公告)号:US20240311954A1

    公开(公告)日:2024-09-19

    申请号:US18437734

    申请日:2024-02-09

    Applicant: TUSIMPLE, INC.

    CPC classification number: G06T3/047 G05D1/249 G06T5/20 G06T5/80 G06T2207/30252

    Abstract: A system and method for fisheye image processing can be configured to: receive fisheye image data from at least one fisheye lens camera associated with an autonomous vehicle, the fisheye image data representing at least one fisheye image frame; partition the fisheye image frame into a plurality of image portions representing portions of the fisheye image frame; warp each of the plurality of image portions to map an arc of a camera projected view into a line corresponding to a mapped target view, the mapped target view being generally orthogonal to a line between a camera center and a center of the arc of the camera projected view; combine the plurality of warped image portions to form a combined resulting fisheye image data set representing recovered or distortion-reduced fisheye image data corresponding to the fisheye image frame; generate auto-calibration data representing a correspondence between pixels in the at least one fisheye image frame and corresponding pixels in the combined resulting fisheye image data set; and provide the combined resulting fisheye image data set as an output for other autonomous vehicle subsystems.

    SYSTEM AND METHOD FOR SEMANTIC SEGMENTATION USING HYBRID DILATED CONVOLUTION (HDC)

    公开(公告)号:US20200265244A1

    公开(公告)日:2020-08-20

    申请号:US16867472

    申请日:2020-05-05

    Applicant: TUSIMPLE, INC.

    Abstract: A system and method for semantic segmentation using hybrid dilated convolution (HDC) are disclosed. A particular embodiment includes: receiving an input image; producing a feature map from the input image; performing a convolution operation on the feature map and producing multiple convolution layers; grouping the multiple convolution layers into a plurality of groups; applying different dilation rates for different convolution layers in a single group of the plurality of groups; and applying a same dilation rate setting across all groups of the plurality of groups.

    SYSTEM AND METHOD FOR IMAGE LOCALIZATION BASED ON SEMANTIC SEGMENTATION

    公开(公告)号:US20200160067A1

    公开(公告)日:2020-05-21

    申请号:US16752632

    申请日:2020-01-25

    Applicant: TuSimple, Inc.

    Abstract: A system and method for image localization based on semantic segmentation are disclosed. A particular embodiment includes: receiving image data from an image generating device mounted on an autonomous vehicle; performing semantic segmentation or other object detection on the received image data to identify and label objects in the image data and produce semantic label image data; identifying extraneous objects in the semantic label image data; removing the extraneous objects from the semantic label image data; comparing the semantic label image data to a baseline semantic label map; and determining a vehicle location of the autonomous vehicle based on information in a matching baseline semantic label map.

    SENSOR LAYOUT TECHNIQUES
    7.
    发明公开

    公开(公告)号:US20230266759A1

    公开(公告)日:2023-08-24

    申请号:US18167993

    申请日:2023-02-13

    Applicant: TuSimple, Inc.

    CPC classification number: G05D1/0088 G05D2201/0213

    Abstract: A system installed in a vehicle includes a first group of sensing devices configured to allow a first level of autonomous operation of the vehicle; a second group of sensing devices configured to allow a second level of autonomous operation of the vehicle, the second group of sensing devices including primary sensing devices and backup sensing devices; a third group of sensing devices configured to allow the vehicle to perform a safe stop maneuver; and a control element communicatively coupled to the first group of sensing devices, the second group of sensing devices, and the third group of sensing devices. The control element is configured to: receive data from at least one of the first group, the second group, or the third group of sensing devices, and provide a control signal to a sensing device based on categorization information indicating a group to which the sensing device belongs.

    SYSTEM AND METHOD FOR LATERAL VEHICLE DETECTION

    公开(公告)号:US20210342602A1

    公开(公告)日:2021-11-04

    申请号:US17377206

    申请日:2021-07-15

    Applicant: TUSIMPLE, INC.

    Abstract: A system and method for lateral vehicle detection is disclosed. A particular embodiment can be configured to: receive lateral image data from at least one laterally-facing camera associated with an autonomous vehicle; warp the lateral image data based on a line parallel to a side of the autonomous vehicle; perform object extraction on the warped lateral image data to identify extracted objects in the warped lateral image data; and apply bounding boxes around the extracted objects.

    SYSTEM AND METHOD FOR INSTANCE-LEVEL LANE DETECTION FOR AUTONOMOUS VEHICLE CONTROL

    公开(公告)号:US20210216792A1

    公开(公告)日:2021-07-15

    申请号:US17214828

    申请日:2021-03-27

    Applicant: TuSimple, Inc.

    Abstract: A system and method for instance-level lane detection for autonomous vehicle control are disclosed. A particular embodiment includes: receiving image data from an image data collection system associated with an autonomous vehicle; performing an operational phase comprising extracting roadway lane marking features from the image data, causing a plurality of trained tasks to execute concurrently to generate instance-level lane detection results based on the image data, the plurality of trained tasks having been individually trained with different features of training image data received from a training image data collection system and corresponding ground truth data, the training image data and the ground truth data comprising data collected from real-world traffic scenarios; causing the plurality of trained tasks to generate task-specific predictions of feature characteristics based on the image data and to generate corresponding instance-level lane detection results; and providing the instance-level lane detection results to an autonomous vehicle subsystem of the autonomous vehicle.

Patent Agency Ranking