-
公开(公告)号:US12066525B2
公开(公告)日:2024-08-20
申请号:US18344433
申请日:2023-06-29
Applicant: Waymo LLC
CPC classification number: G01S13/867 , B60W30/08 , G01S7/417 , G01S13/86 , G01S13/89 , G01S13/931 , G06T7/70 , B60W2420/403 , B60W2420/408 , B60W2554/00 , B60W2754/10 , G01S2013/93271 , G06T2207/10024 , G06T2207/10028 , G06T2207/20084 , G06T2207/30252
Abstract: Example embodiments relate to techniques for three dimensional (3D) object detection and localization. A computing system may cause a radar unit to transmit radar signals and receive radar reflections relative to an environment of a vehicle. Based on the radar reflections, the computing system may determine a heading and a range for a nearby object. The computing system may also receive an image depicting a portion of the environment that includes the object from a vehicle camera and remove peripheral areas of the image to generate an image patch that focuses upon the object based on the heading and the range for the object. The image patch and the heading and the range for the object can be provided as inputs into a neural network that provides output parameters corresponding to the object, which can be used to control the vehicle.
-
公开(公告)号:US20230249712A1
公开(公告)日:2023-08-10
申请号:US17669215
申请日:2022-02-10
Applicant: Waymo LLC
Inventor: Xu Chen , Chao-Yeh Chen , Justin Yu Zheng , Zhinan Xu
IPC: B60W60/00 , G01S13/931 , G01S17/931 , G05B13/02 , G06N3/04 , G06V20/58 , G06V10/764 , G06V10/82
CPC classification number: B60W60/0015 , G01S13/931 , G01S17/931 , G05B13/027 , G06N3/0445 , G06N3/0454 , G06V20/58 , G06V10/764 , G06V10/82 , B60W2420/42 , B60W2420/52 , B60W2420/403 , B60W2554/4026 , B60W2554/4029
Abstract: The described aspects and implementations enable efficient calibration of a sensing system of a vehicle. In one implementation, disclosed is a method and a system to perform the method, the system including the sensing system configured to collect sensing data, characterizing an environment of the vehicle, the sensing data including infrared sensing data. The system further includes a data processing system operatively coupled to the sensing system and configured to process the sensing data using a classifier machine-learning model to obtain a classification of one or more vulnerable road users present in the environment of the vehicle.
-
公开(公告)号:US12175767B2
公开(公告)日:2024-12-24
申请号:US17715838
申请日:2022-04-07
Applicant: Waymo LLC
Inventor: Ruichi Yu , Xu Chen , Shiwei Sheng , Luming Tang , Chieh-En Tsai
Abstract: The described aspects and implementations enable efficient calibration of a sensing system of a vehicle. In one implementation, disclosed is a method and a system to perform the method, the system including the sensing system configured to obtain a plurality of images associated with a corresponding time of a plurality of times. The system further includes a data processing system operatively coupled to the sensing system and configured to generate a plurality of sets of feature tensors (FTs) associated with one or more objects of the environment depicted in a respective image. The data processing system is further to obtain a combined FT and process the combined FT using a neural network to identify one or more tracks characterizing motion of a respective object.
-
公开(公告)号:US20230350051A1
公开(公告)日:2023-11-02
申请号:US18344433
申请日:2023-06-29
Applicant: Waymo LLC
CPC classification number: G01S13/867 , G06T7/70 , B60W30/08 , G01S7/417 , G01S13/86 , G01S13/89 , G01S13/931 , G01S2013/93271 , B60W2554/00 , B60W2754/10 , B60W2420/42 , B60W2420/52 , G06T2207/10024 , G06T2207/10028 , G06T2207/20084 , G06T2207/30252
Abstract: Example embodiments relate to techniques for three dimensional (3D) object detection and localization. A computing system may cause a radar unit to transmit radar signals and receive radar reflections relative to an environment of a vehicle. Based on the radar reflections, the computing system may determine a heading and a range for a nearby object. The computing system may also receive an image depicting a portion of the environment that includes the object from a vehicle camera and remove peripheral areas of the image to generate an image patch that focuses upon the object based on the heading and the range for the object. The image patch and the heading and the range for the object can be provided as inputs into a neural network that provides output parameters corresponding to the object, which can be used to control the vehicle.
-
公开(公告)号:US20230038842A1
公开(公告)日:2023-02-09
申请号:US17444338
申请日:2021-08-03
Applicant: Waymo LLC
Inventor: Ruichi Yu , Shiwei Sheng , Kang Li , Xu Chen
Abstract: The described aspects and implementations enable fast and accurate object identification in autonomous vehicle (AV) applications by combining radar data with camera images. In one implementation, disclosed is a method and a system to perform the method that includes obtaining a radar image of a first hypothetical object in an environment of the AV, obtaining a camera image of a second hypothetical object in the environment of the AV, and processing the radar image and the camera image using one or more machine-learning models MLMs to obtain a prediction measure representing a likelihood that the first hypothetical object and the second hypothetical object correspond to a same object in the environment of the AV.
-
公开(公告)号:US20220180549A1
公开(公告)日:2022-06-09
申请号:US17545987
申请日:2021-12-08
Applicant: Waymo LLC
Inventor: Longlong Jing , Ruichi Yu , Jiyang Gao , Henrik Kretzschmar , Kang Li , Ruizhongtai Qi , Hang Zhao , Alper Ayvaci , Xu Chen , Dillon Cower , Congcong Li
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for predicting three-dimensional object locations from images. One of the methods includes obtaining a sequence of images that comprises, at each of a plurality of time steps, a respective image that was captured by a camera at the time step; generating, for each image in the sequence, respective pseudo-lidar features of a respective pseudo-lidar representation of a region in the image that has been determined to depict a first object; generating, for a particular image at a particular time step in the sequence, image patch features of the region in the particular image that has been determined to depict the first object; and generating, from the respective pseudo-lidar features and the image patch features, a prediction that characterizes a location of the first object in a three-dimensional coordinate system at the particular time step in the sequence.
-
公开(公告)号:US20230143433A1
公开(公告)日:2023-05-11
申请号:US17173818
申请日:2021-02-11
Applicant: Waymo LLC
IPC: G01S13/931 , G01S13/86 , G01S7/41 , B60W30/08 , G06T7/70
CPC classification number: G01S13/931 , G01S13/867 , G01S7/417 , B60W30/08 , G06T7/70 , B60W2420/52 , B60W2754/10 , B60W2554/00 , B60W2420/42 , G06T2207/10028 , G06T2207/30252 , G06T2207/10024 , G06T2207/20084
Abstract: Example embodiments relate to techniques for three dimensional (3D) object detection and localization. A computing system may cause a radar unit to transmit radar signals and receive radar reflections relative to an environment of a vehicle. Based on the radar reflections, the computing system may determine a heading and a range for a nearby object. The computing system may also receive an image depicting a portion of the environment that includes the object from a vehicle camera and remove peripheral areas of the image to generate an image patch that focuses upon the object based on the heading and the range for the object. The image patch and the heading and the range for the object can be provided as inputs into a neural network that provides output parameters corresponding to the object, which can be used to control the vehicle.
-
公开(公告)号:US20240303827A1
公开(公告)日:2024-09-12
申请号:US18600449
申请日:2024-03-08
Applicant: Waymo LLC
Inventor: Longlong Jing , Ruichi Yu , Xu Chen , Zhengli Zhao , Shiwei Sheng
CPC classification number: G06T7/20 , G01S17/89 , G06V10/44 , G06T2207/30241 , G06V2201/07
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for tracking objects in an environment across time. In one aspect, a method comprises: receiving a set of current object detections, each characterizing features of a respective detected object; maintaining data, including track query feature representations, that identifies one or more object tracks (each associated with respective earlier object detections classified as characterizing the same object; and, for each object track: (i) selecting a subset of the current object detections as candidate object detections for the object track, (ii) generating a respective association score for each candidate object detection based on an input derived from the candidate object detections and the track query feature representation for the object track using a track-detection interaction neural network, and (iii) determining whether to associate any of the current object detections with the object track based on the respective association scores.
-
公开(公告)号:US20230326215A1
公开(公告)日:2023-10-12
申请号:US17715838
申请日:2022-04-07
Applicant: Waymo LLC
Inventor: Ruichi Yu , Xu Chen , Shiwei Sheng , Luming Tang , Chieh-En Tsai
CPC classification number: G06V20/58 , G06V10/82 , G06T7/20 , B60W60/001 , G06T2207/20084 , G06T2207/10028 , B60W2420/42
Abstract: The described aspects and implementations enable efficient calibration of a sensing system of a vehicle. In one implementation, disclosed is a method and a system to perform the method, the system including the sensing system configured to obtain a plurality of images associated with a corresponding time of a plurality of times. The system further includes a data processing system operatively coupled to the sensing system and configured to generate a plurality of sets of feature tensors (FTs) associated with one or more objects of the environment depicted in a respective image. The data processing system is further to obtain a combined FT and process the combined FT using a neural network to identify one or more tracks characterizing motion of a respective object.
-
公开(公告)号:US20250078927A1
公开(公告)日:2025-03-06
申请号:US18953053
申请日:2024-11-19
Applicant: Waymo LLC
Inventor: Ruichi Yu , Xu Chen , Shiwei Sheng , Luming Tang , Chieh-En Tsai
Abstract: The described aspects and implementations enable efficient calibration of a sensing system of a vehicle. In one implementation, disclosed is a method and a system to perform the method, the system including the sensing system configured to obtain a plurality of images associated with a corresponding time of a plurality of times. The system further includes a data processing system operatively coupled to the sensing system and configured to generate a plurality of sets of feature tensors (FTs) associated with one or more objects of the environment depicted in a respective image. The data processing system is further to obtain a combined FT and process the combined FT using a neural network to identify one or more tracks characterizing motion of a respective object.
-
-
-
-
-
-
-
-
-