公开(公告)号：US11734563B2

公开(公告)日：2023-08-22

申请号：US17739289

申请日：2022-05-09

Applicant: TuSimple, Inc.

Inventor： Panqu Wang ,  Tian Li

IPC: G06V20/58 ,  G06V20/56 ,  G06N3/08 ,  G05D1/00 ,  G05D1/02 ,  G06N3/04 ,  G06V10/82 ,  G06V10/44 ,  G06F18/214 ,  G06V10/764

CPC classification number: G06N3/08 ,  G05D1/0088 ,  G05D1/0246 ,  G06F18/214 ,  G06N3/04 ,  G06V10/454 ,  G06V10/764 ,  G06V10/82 ,  G06V20/56 ,  G06V20/584 ,  G05D2201/0213

Abstract: A system and method for taillight signal recognition using a convolutional neural network is disclosed. An example embodiment includes: receiving a plurality of image frames from one or more image-generating devices of an autonomous vehicle; using a single-frame taillight illumination status annotation dataset and a single-frame taillight mask dataset to recognize a taillight illumination status of a proximate vehicle identified in an image frame of the plurality of image frames, the single-frame taillight illumination status annotation dataset including one or more taillight illumination status conditions of a right or left vehicle taillight signal, the single-frame taillight mask dataset including annotations to isolate a taillight region of a vehicle; and using a multi-frame taillight illumination status dataset to recognize a taillight illumination status of the proximate vehicle in multiple image frames of the plurality of image frames, the multiple image frames being in temporal succession.

公开(公告)号：US20230219488A1

公开(公告)日：2023-07-13

申请号：US18149901

申请日：2023-01-04

Applicant: TuSimple, Inc.

Inventor： Yu-Ju Hsu ,  Xiaoling Han ,  Yijing Li ,  Zehua Huang ,  Lingting Ge ,  Panqu Wang ,  Shuhan Yang

IPC: B60Q1/14

CPC classification number: B60Q1/143 ,  B60Q2300/054 ,  B60Q2300/42 ,  G06V20/58

Abstract: A system comprises a headlight mounted on an autonomous vehicle. The headlight is configured to illuminate at least a portion of a road the autonomous vehicle is on. The system further comprises a control device associated with the autonomous vehicle. The processor obtains information about an environment around the autonomous vehicle. The processor determines that at least a portion of the road should be illuminated if the information indicates that an illumination level of the portion of the road is less than a threshold illumination level. The processor adjusts the headlight to illuminate at least the portion of the road in response to determining that at least the portion of the road should be illuminated.

公开(公告)号：US11227500B2

公开(公告)日：2022-01-18

申请号：US16781907

申请日：2020-02-04

Applicant: TuSimple, Inc.

Inventor： Panqu Wang

IPC: G06K9/00 ,  G08G1/16 ,  G06T7/70 ,  G06T7/62

Abstract: A system and method for determining car to lane distance is provided. In one aspect, the system includes a camera configured to generate an image, a processor, and a computer-readable memory. The processor is configured to receive the image from the camera, generate a wheel segmentation map representative of one or more wheels detected in the image, and generate a lane segmentation map representative of one or more lanes detected in the image. For at least one of the wheels in the wheel segmentation map, the processor is also configured to determine a distance between the wheel and at least one nearby lane in the lane segmentation map. The processor is further configured to determine a distance between a vehicle in the image and the lane based on the distance between the wheel and the lane.

公开(公告)号：US11010616B2

公开(公告)日：2021-05-18

申请号：US16867472

申请日：2020-05-05

Applicant: TUSIMPLE, INC.

Inventor： Zehua Huang ,  Pengfei Chen ,  Panqu Wang

IPC: G06K9/00 ,  G06K9/62 ,  G06N3/02 ,  G06T7/10

Abstract: A system and method for semantic segmentation using hybrid dilated convolution (HDC) are disclosed. A particular embodiment includes: receiving an input image; producing a feature map from the input image; performing a convolution operation on the feature map and producing multiple convolution layers; grouping the multiple convolution layers into a plurality of groups; applying different dilation rates for different convolution layers in a single group of the plurality of groups; and applying a same dilation rate setting across all groups of the plurality of groups.

公开(公告)号：US10679074B2

公开(公告)日：2020-06-09

申请号：US16209262

申请日：2018-12-04

Applicant: TuSimple, Inc.

Inventor： Zehua Huang ,  Pengfei Chen ,  Panqu Wang

IPC: G06K9/00 ,  G06K9/62 ,  G06N3/02 ,  G06T7/10

Abstract: A system and method for semantic segmentation using hybrid dilated convolution (HDC) are disclosed. A particular embodiment includes: receiving an input image; producing a feature map from the input image; performing a convolution operation on the feature map and producing multiple convolution layers; grouping the multiple convolution layers into a plurality of groups; applying different dilation rates for different convolution layers in a single group of the plurality of groups; and applying a same dilation rate setting across all groups of the plurality of groups.

公开(公告)号：US10671873B2

公开(公告)日：2020-06-02

申请号：US15917331

申请日：2018-03-09

Applicant: TuSimple, Inc.

Inventor： Panqu Wang ,  Pengfei Chen

IPC: G06K9/32 ,  G06K9/00 ,  G06K9/46 ,  G06K9/62 ,  G06T7/194 ,  G01S17/89

Abstract: A system and method for vehicle wheel detection is disclosed. A particular embodiment can be configured to: receive training image data from a training image data collection system; obtain ground truth data corresponding to the training image data; perform a training phase to train one or more classifiers for processing images of the training image data to detect vehicle wheel objects in the images of the training image data; receive operational image data from an image data collection system associated with an autonomous vehicle; and perform an operational phase including applying the trained one or more classifiers to extract vehicle wheel objects from the operational image data and produce vehicle wheel object data.

公开(公告)号：US12243428B2

公开(公告)日：2025-03-04

申请号：US18121117

申请日：2023-03-14

Applicant: TUSIMPLE, INC.

Inventor： Zhipeng Yan ,  Lingting Ge ,  Pengfei Chen ,  Panqu Wang

IPC: G08G1/16 ,  G05D1/00 ,  G06T3/18 ,  G06T7/73 ,  G06V10/44 ,  G06V10/75 ,  G06V20/56 ,  G06V20/58 ,  G08G1/04

Abstract: A system and method for lateral vehicle detection is disclosed. A particular embodiment can be configured to: receive lateral image data from at least one laterally-facing camera associated with an autonomous vehicle; warp the lateral image data based on a line parallel to a side of the autonomous vehicle; perform object extraction on the warped lateral image data to identify extracted objects in the warped lateral image data; and apply bounding boxes around the extracted objects.

公开(公告)号：US12033396B2

公开(公告)日：2024-07-09

申请号：US18339961

申请日：2023-06-22

Applicant: TUSIMPLE, INC.

Inventor： Panqu Wang

IPC: G06K9/00 ,  G06F16/29 ,  G06N20/00 ,  G06T7/62 ,  G06T7/80 ,  G06V20/58

CPC classification number: G06V20/58 ,  G06F16/29 ,  G06N20/00 ,  G06T7/62 ,  G06T7/80

Abstract: A system and method for three-dimensional (3D) object detection is disclosed. A particular embodiment can be configured to: receive image data from a camera associated with a vehicle, the image data representing an image frame; use a machine learning module to determine at least one pixel coordinate of a two-dimensional (2D) bounding box around an object in the image frame; use the machine learning module to determine at least one vertex of a three-dimensional (3D) bounding box around the object; obtain camera calibration information associated with the camera; and determine 3D attributes of the object using the 3D bounding box and the camera calibration information.

公开(公告)号：US11865967B2

公开(公告)日：2024-01-09

申请号：US18149901

申请日：2023-01-04

Applicant: TuSimple, Inc.

Inventor： Yu-Ju Hsu ,  Xiaoling Han ,  Yijing Li ,  Zehua Huang ,  Lingting Ge ,  Panqu Wang ,  Shuhan Yang

IPC: B60Q1/14 ,  G06V20/58

CPC classification number: B60Q1/143 ,  B60Q2300/054 ,  B60Q2300/42 ,  G06V20/58

Abstract: A system comprises a headlight mounted on an autonomous vehicle. The headlight is configured to illuminate at least a portion of a road the autonomous vehicle is on. The system further comprises a control device associated with the autonomous vehicle. The processor obtains information about an environment around the autonomous vehicle. The processor determines that at least a portion of the road should be illuminated if the information indicates that an illumination level of the portion of the road is less than a threshold illumination level. The processor adjusts the headlight to illuminate at least the portion of the road in response to determining that at least the portion of the road should be illuminated.

公开(公告)号：US11830205B2

公开(公告)日：2023-11-28

申请号：US17656415

申请日：2022-03-24

Applicant: TUSIMPLE, INC.

Inventor： Lingting Ge ,  Pengfei Chen ,  Panqu Wang

IPC: G06T7/00 ,  G06T7/277 ,  G06N3/08 ,  G06N3/04 ,  G06T7/246 ,  G06T7/73 ,  G06V20/58 ,  G06V10/764 ,  G06V10/82 ,  G06V10/62

CPC classification number: G06T7/277 ,  G06N3/04 ,  G06N3/08 ,  G06T7/248 ,  G06T7/74 ,  G06V10/764 ,  G06V10/82 ,  G06V20/58 ,  B60Y2400/3015 ,  G06T2207/30248 ,  G06V10/62

Abstract: A system and method for online real-time multi-object tracking is disclosed. A particular embodiment can be configured to: receive image frame data from at least one camera associated with an autonomous vehicle; generate similarity data corresponding to a similarity between object data in a previous image frame compared with object detection results from a current image frame; use the similarity data to generate data association results corresponding to a best matching between the object data in the previous image frame and the object detection results from the current image frame; cause state transitions in finite state machines for each object according to the data association results; and provide as an output object tracking output data corresponding to the states of the finite state machines for each object.