-
11.
公开(公告)号:US20190101927A1
公开(公告)日:2019-04-04
申请号:US15721797
申请日:2017-09-30
Applicant: TuSimple
Inventor: Xiangchen ZHAO , Tian LI , Panqu WANG , Pengfei CHEN
Abstract: A system and method for multitask processing for autonomous vehicle computation and control are disclosed. A particular embodiment includes: receiving training image data from a training image data collection system; obtaining ground truth data corresponding to the training image data; performing a training phase to train a plurality of tasks associated with features of the training image data, the training phase including extracting common features from the training image data, causing the plurality of tasks to generate task-specific predictions based on the training image data, determining a bias between the task-specific prediction for each task and corresponding task-specific ground truth data, and adjusting parameters of each of the plurality of tasks to cause the bias to meet a pre-defined confidence level; receiving image data from an image data collection system associated with an autonomous vehicle; and performing an operational phase including extracting common features from the image data, causing the plurality of trained tasks to concurrently generate task-specific predictions based on the image data, and output the task-specific predictions to an autonomous vehicle subsystem of the autonomous vehicle.
-
公开(公告)号:US20190050667A1
公开(公告)日:2019-02-14
申请号:US16159060
申请日:2018-10-12
Applicant: TuSimple
Inventor: Panqu WANG , Pengfei CHEN , Zehua HUANG
Abstract: A system method for occluding contour detection using a fully convolutional neural network is disclosed. A particular embodiment includes: receiving an input image; producing a feature map from the input image by semantic segmentation; learning an array of upscaling filters to upscale the feature map into a final dense feature map of a desired size; applying the array of upscaling filters to the feature map to produce contour information of objects and object instances detected in the input image; and applying the contour information onto the input image.
-
公开(公告)号:US20240320987A1
公开(公告)日:2024-09-26
申请号:US18598384
申请日:2024-03-07
Applicant: TuSimple, Inc.
Inventor: Haiping WU , Long SHA , Hongyuan DU , Zilong GUO , Yihe TANG , Tingyu MAO , Pengfei CHEN , Panqu WANG , Rundong GE
CPC classification number: G06V20/584 , G06T7/12 , G06T7/13 , G06T7/50 , G06T7/70 , G06V10/25 , G06T2207/30196 , G06V2201/07
Abstract: Techniques are described for performing an image processing technique on frames of a camera located on or in a vehicle. An example technique includes receiving, by a computer located in a vehicle, a first image frame from a camera located on or in the vehicle; obtaining a first combined set of information by combining a first set of information about an object detected from the first image frame and a second set of information about a set of objects detected from a second image frame, where the set of objects includes the object; obtaining, by using the first combined set of information, a second combined set of information about the object from the first image frame and from the second image frame; and causing the vehicle to perform a driving related operation in response to determining a characteristic of the object using the second combined set of information.
-
公开(公告)号:US20240311954A1
公开(公告)日:2024-09-19
申请号:US18437734
申请日:2024-02-09
Applicant: TUSIMPLE, INC.
Inventor: Zhipeng YAN , Pengfei CHEN , Panqu WANG
CPC classification number: G06T3/047 , G05D1/249 , G06T5/20 , G06T5/80 , G06T2207/30252
Abstract: A system and method for fisheye image processing can be configured to: receive fisheye image data from at least one fisheye lens camera associated with an autonomous vehicle, the fisheye image data representing at least one fisheye image frame; partition the fisheye image frame into a plurality of image portions representing portions of the fisheye image frame; warp each of the plurality of image portions to map an arc of a camera projected view into a line corresponding to a mapped target view, the mapped target view being generally orthogonal to a line between a camera center and a center of the arc of the camera projected view; combine the plurality of warped image portions to form a combined resulting fisheye image data set representing recovered or distortion-reduced fisheye image data corresponding to the fisheye image frame; generate auto-calibration data representing a correspondence between pixels in the at least one fisheye image frame and corresponding pixels in the combined resulting fisheye image data set; and provide the combined resulting fisheye image data set as an output for other autonomous vehicle subsystems.
-
公开(公告)号:US20210256664A1
公开(公告)日:2021-08-19
申请号:US17308911
申请日:2021-05-05
Applicant: TUSIMPLE, INC.
Inventor: Pengfei CHEN , Nan YU , Naiyan WANG , Xiaodi HOU
Abstract: Disclosed are devices, systems and methods for processing an image. In one aspect a method includes receiving an image from a sensor array including an x-y array of pixels, each pixel in the x-y array of pixels having a value selected from one of three primary colors, based on a corresponding x-y value in a mask pattern. The method may further include generating a preprocessed image by performing preprocessing on the image. The method may further include performing perception on the preprocessed image to determine one or more outlines of physical objects.
-
公开(公告)号:US20200265244A1
公开(公告)日:2020-08-20
申请号:US16867472
申请日:2020-05-05
Applicant: TUSIMPLE, INC.
Inventor: Zehua HUANG , Pengfei CHEN , Panqu WANG
Abstract: A system and method for semantic segmentation using hybrid dilated convolution (HDC) are disclosed. A particular embodiment includes: receiving an input image; producing a feature map from the input image; performing a convolution operation on the feature map and producing multiple convolution layers; grouping the multiple convolution layers into a plurality of groups; applying different dilation rates for different convolution layers in a single group of the plurality of groups; and applying a same dilation rate setting across all groups of the plurality of groups.
-
公开(公告)号:US20200160067A1
公开(公告)日:2020-05-21
申请号:US16752632
申请日:2020-01-25
Applicant: TuSimple, Inc.
Inventor: Zehua HUANG , Pengfei CHEN , Panqu WANG , Ke XU
Abstract: A system and method for image localization based on semantic segmentation are disclosed. A particular embodiment includes: receiving image data from an image generating device mounted on an autonomous vehicle; performing semantic segmentation or other object detection on the received image data to identify and label objects in the image data and produce semantic label image data; identifying extraneous objects in the semantic label image data; removing the extraneous objects from the semantic label image data; comparing the semantic label image data to a baseline semantic label map; and determining a vehicle location of the autonomous vehicle based on information in a matching baseline semantic label map.
-
公开(公告)号:US20190286916A1
公开(公告)日:2019-09-19
申请号:US15924249
申请日:2018-03-18
Applicant: TuSimple
Inventor: Zhipeng YAN , Lingting GE , Pengfei CHEN , Panqu WANG
Abstract: A system and method for lateral vehicle detection is disclosed. A particular embodiment can be configured to: receive lateral image data from at least one laterally-facing camera associated with an autonomous vehicle; warp the lateral image data based on a line parallel to a side of the autonomous vehicle; perform object extraction on the warped lateral image data to identify extracted objects in the warped lateral image data; and apply bounding boxes around the extracted objects.
-
19.
公开(公告)号:US20180365835A1
公开(公告)日:2018-12-20
申请号:US15623323
申请日:2017-06-14
Applicant: TuSimple
Inventor: Zhipeng YAN , Zehua HUANG , Pengfei CHEN , Panqu WANG
Abstract: A system and method for actively selecting and labeling images for semantic segmentation are disclosed. A particular embodiment includes: receiving image data from an image generating device; performing semantic segmentation or other object detection on the received image data to identify and label objects in the image data and produce semantic label image data; determining the quality of the semantic label image data based on prediction probabilities associated with regions or portions of the image; and identifying a region or portion of the image for manual labeling if an associated prediction probability is below a pre-determined threshold.
-
公开(公告)号:US20180260651A1
公开(公告)日:2018-09-13
申请号:US15917331
申请日:2018-03-09
Applicant: TuSimple
Inventor: Panqu WANG , Pengfei CHEN
Abstract: A system and method for vehicle wheel detection is disclosed. A particular embodiment can be configured to: receive training image data from a training image data collection system; obtain ground truth data corresponding to the training image data; perform a training phase to train one or more classifiers for processing images of the training image data to detect vehicle wheel objects in the images of the training image data; receive operational image data from an image data collection system associated with an autonomous vehicle; and perform an operational phase including applying the trained one or more classifiers to extract vehicle wheel objects from the operational image data and produce vehicle wheel object data.
-
-
-
-
-
-
-
-
-