-
公开(公告)号:US20210397857A1
公开(公告)日:2021-12-23
申请号:US16909950
申请日:2020-06-23
Applicant: TUSIMPLE, INC.
Inventor: Siyuan LIU , Lingting GE , Chenzhe QIAN , Zehua HUANG , Xiaodi HOU
Abstract: Image processing techniques are described to obtain an image from a camera located on a vehicle while the vehicle is being driven, cropping a portion of the obtained image corresponding to a region of interest, detecting an object in the cropped portion, adding a bounding box around the detected object, determining position(s) of reference point(s) on the bounding box, and determining a location of the detected object in a spatial region where the vehicle is being driven based on the determined one or more positions of the second set of one or more reference points on the bounding box.
-
公开(公告)号:US20200265249A1
公开(公告)日:2020-08-20
申请号:US16868400
申请日:2020-05-06
Applicant: TUSIMPLE, INC.
Inventor: Lingting GE , Pengfei CHEN , Panqu WANG
Abstract: A system and method for online real-time multi-object tracking is disclosed. A particular embodiment can be configured to: receive image frame data from at least one camera associated with an autonomous vehicle; generate similarity data corresponding to a similarity between object data in a previous image frame compared with object detection results from a current image frame; use the similarity data to generate data association results corresponding to a best matching between the object data in the previous image frame and the object detection results from the current image frame; cause state transitions in finite state machines for each object according to the data association results; and provide as an output object tracking output data corresponding to the states of the finite state machines for each object.
-
公开(公告)号:US20250085115A1
公开(公告)日:2025-03-13
申请号:US18501362
申请日:2023-11-03
Applicant: TuSimple, Inc.
Inventor: Hao XIAO , Yiqian GAN , Ethan ZHANG , Xin YE , Yizhe ZHAO , Zhe HUANG , Lingting GE , Robert August ROSSI, JR.
IPC: G01C21/30
Abstract: A computer-implemented method of trajectory prediction includes obtaining a first cross-attention between a vectorized representation of a road map near a vehicle and information obtained from a rasterized representation of an environment near the vehicle by processing through a first cross-attention stage; obtaining a second cross-attention between a vectorized representation of a vehicle history and information obtained from the rasterized representation by processing through a second cross-attention stage; operating a scene encoder on the first cross-attention and the second cross-attention; operating a trajectory decoder on an output of the scene encoder; obtaining one or more trajectory predictions by performing one or more queries on the trajectory decoder.
-
公开(公告)号:US20250074463A1
公开(公告)日:2025-03-06
申请号:US18434630
申请日:2024-02-06
Applicant: TuSimple, Inc.
Inventor: Ethan ZHANG , Hao XIAO , Yiqian GAN , Yizhe ZHAO , Zhe HUANG , Lingting GE
IPC: B60W60/00 , B60W30/18 , B60W50/00 , G06N3/0442 , G06N3/0464
Abstract: A method of predicting vehicle trajectory includes operating a scene encoder on an environmental representation surrounding a vehicle; concatenating an output of the scene encoder with a history trajectory; applying a sequence encoder to a result of the concatenating; refining an output of the sequence encoder based on the history trajectory; and generating one or more predicted future trajectories by operating a decoder on an output of the refining.
-
公开(公告)号:US20250054286A1
公开(公告)日:2025-02-13
申请号:US18475988
申请日:2023-09-27
Applicant: TuSimple, Inc.
Inventor: Zhe HUANG , Lingting GE , Yizhe ZHAO
Abstract: An image processing method includes performing, using images obtained from one or more sensors onboard a vehicle, a 2-dimensional (2D) feature extraction; performing, a 3-dimensional (3D) feature extraction on the images; detecting objects in the images by fusing detection results from the 2D feature extraction and the 3D feature extraction.
-
公开(公告)号:US20250042369A1
公开(公告)日:2025-02-06
申请号:US18486874
申请日:2023-10-13
Applicant: TuSimple, Inc.
Inventor: Yizhe ZHAO , Zhe CHEN , Lingting GE , Panqu WANG
Abstract: Techniques are described for determining a set of pose information for an object when multiple sets of pose information are determined for a same object from multiple images. An example driving operation method includes obtaining, by a computer located in a vehicle, at least two sets of pose information related to an object located on a road on which the vehicle is operating, where each set of pose information includes characteristic(s) about the object, and where each set of pose information is determined from an image obtained by a camera; determining at least two weighted output vectors; determining, for the object, a set of pose information that are based on a combined weighted output vector that is obtained by combining the at least two weighted output vectors; and causing the vehicle to perform a driving-related operation using the set of pose information for the object.
-
公开(公告)号:US20240182081A1
公开(公告)日:2024-06-06
申请号:US18440738
申请日:2024-02-13
Applicant: TUSIMPLE, INC.
Inventor: Yiqian GAN , Yijie WANG , Xiaodi HOU , Lingting GE
CPC classification number: B60W60/0027 , G06T3/40 , G06T7/62 , G06T7/73 , G06V20/58 , G08G1/165 , G08G1/166 , B60W2420/403 , B60W2554/20 , B60W2554/4042 , B60W2554/4043 , B60W2554/4044 , G06T2207/30261
Abstract: Autonomous vehicles must accommodate various road configurations such as straight roads, curved roads, controlled intersections, uncontrolled intersections, and many others. Autonomous driving systems must make decisions about the speed and distance of traffic and about obstacles including obstacles that obstruct the view of the autonomous vehicle's sensors. For example, at intersections, the autonomous driving system must identify vehicles in the path of the autonomous vehicle or potentially in the path based on a planned path, estimate the distance to those vehicles, and estimate the speeds of those vehicles. Then, based on those and the road configuration and environmental conditions, the autonomous driving system must decide whether it is safe to proceed along the planned path or not, and when it is safe to proceed.
-
公开(公告)号:US20240046489A1
公开(公告)日:2024-02-08
申请号:US18489250
申请日:2023-10-18
Applicant: TUSIMPLE, INC.
Inventor: Lingting GE , Pengfei CHEN , Panqu WANG
CPC classification number: G06T7/277 , G06N3/08 , G06N3/04 , G06T7/248 , G06T7/74 , G06V20/58 , G06V10/764 , G06V10/82 , B60Y2400/3015 , G06T2207/30248 , G06V10/62
Abstract: A system and method for online real-time multi-object tracking is disclosed. A particular embodiment can be configured to: receive image frame data from at least one camera associated with an autonomous vehicle; generate similarity data corresponding to a similarity between object data in a previous image frame compared with object detection results from a current image frame; use the similarity data to generate data association results corresponding to a best matching between the object data in the previous image frame and the object detection results from the current image frame; cause state transitions in finite state machines for each object according to the data association results; and provide as an output object tracking output data corresponding to the states of the finite state machines for each object.
-
公开(公告)号:US20230399006A1
公开(公告)日:2023-12-14
申请号:US18363541
申请日:2023-08-01
Applicant: TUSIMPLE, INC. , Beijing Tusen Zhitu Technology Co., Ltd.
Inventor: Lingting GE , Yijie WANG , Yiqian GAN , Jianan HAO , Xiaodi HOU
IPC: B60W50/14 , G06T7/73 , G01S17/931 , B60W10/20 , G01S7/00 , G01S17/89 , G05D1/00 , G05D1/02 , G06V10/774 , G06V10/776 , G06V10/80 , G06V20/56 , G06V20/64
CPC classification number: B60W50/14 , G06T7/74 , G01S17/931 , B60W10/20 , G01S7/003 , G01S17/89 , G05D1/0094 , G05D1/0248 , G06V10/774 , G06V10/776 , G06V10/806 , G06V20/56 , G06V20/647 , B60W2420/42 , B60W2420/52 , G06T2207/30244 , G06T2210/12
Abstract: Disclosed are methods and devices related to autonomous driving. In one aspect, a method is disclosed. The method includes determining three-dimensional bounding indicators for one or more first objects in road target information captured by a light detection and ranging (LIDAR) sensor; determining camera bounding indicators for one or more second objects in road image information captured by a camera sensor; processing the road image information to generate a camera matrix; determining projected bounding indicators from the camera matrix and the three-dimensional bounding indicators; determining, from the projected bounding indicators and the camera bounding indicators, associations between the one or more first objects and the one or more second objects to generate combined target information; and applying, by the autonomous driving system, the combined target information to produce a vehicle control signal.
-
公开(公告)号:US20230334696A1
公开(公告)日:2023-10-19
申请号:US18339940
申请日:2023-06-22
Applicant: TUSIMPLE, INC.
Inventor: Yijie WANG , Lingting GE , Yiqian GAN , Xiaodi HOU
CPC classification number: G06T7/74 , G06T7/337 , G06T2207/30184 , G06T2207/30252
Abstract: Techniques are described to estimate orientation of one or more cameras located on a vehicle. The orientation estimation technique can include obtaining an image from a camera located on a vehicle while the vehicle is being driven on a road, determining, from a terrain map, a location of a landmark located at a distance from a location of the vehicle on the road, determining, in the image, pixel locations of the landmark, selecting one pixel location from the determined pixel locations; and calculating values that describe an orientation of the camera using at least an intrinsic matrix and a previously known extrinsic matrix of the camera, where the intrinsic matrix is characterized based on at least the one pixel location and the location of the landmark.
-
-
-
-
-
-
-
-
-