-
公开(公告)号:US12154212B2
公开(公告)日:2024-11-26
申请号:US17098943
申请日:2020-11-16
Applicant: Waymo LLC
Inventor: Zhenpei Yang , Yuning Chai , Yin Zhou , Pei Sun , Henrik Kretzschmar , Sean Rafferty , Dumitru Erhan , Dragomir Anguelov
IPC: G06T17/05 , B60W30/095 , B60W50/06 , B60W60/00 , G06N3/045 , G06N3/08 , G06T7/70 , G06T9/00 , G06T15/00 , G06T15/04
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generated simulated sensor data. One of the methods includes obtaining a surfel map generated from sensor observations of a real-world environment and generating, for each surfel in the surfel map, a respective grid having a plurality of grid cells, wherein each grid has an orientation matching an orientation of a corresponding surfel, and wherein each grid cell within each grid is assigned a respective color value. For a simulated location within a simulated representation of the real-world environment, a textured surfel rendering is generated, including combining color information from grid cells visible from the simulated location within the simulated representation of the real-world environment.
-
公开(公告)号:US20240232647A9
公开(公告)日:2024-07-11
申请号:US18492646
申请日:2023-10-23
Applicant: Waymo LLC
Inventor: Zhaoqi Leng , Guowang Li , Chenxi Liu , Pei Sun , Tong He , Dragomir Anguelov , Mingxing Tan
IPC: G06N3/0985
CPC classification number: G06N3/0985
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a machine learning model on training data. In one aspect, one of the methods include: obtaining a training data set comprising a plurality of training inputs; obtaining data defining an original search space of a plurality of candidate data augmentation policies; generating, from the original search space, a compact search space that has one or more global hyperparameters; and training the machine learning model on the training data using one or more final data augmentation policies generated from the compact search space.
-
公开(公告)号:US20240135195A1
公开(公告)日:2024-04-25
申请号:US18492646
申请日:2023-10-22
Applicant: Waymo LLC
Inventor: Zhaoqi Leng , Guowang Li , Chenxi Liu , Pei Sun , Tong He , Dragomir Anguelov , Mingxing Tan
IPC: G06N3/0985
CPC classification number: G06N3/0985
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a machine learning model on training data. In one aspect, one of the methods include: obtaining a training data set comprising a plurality of training inputs; obtaining data defining an original search space of a plurality of candidate data augmentation policies; generating, from the original search space, a compact search space that has one or more global hyperparameters; and training the machine learning model on the training data using one or more final data augmentation policies generated from the compact search space.
-
公开(公告)号:US20220058818A1
公开(公告)日:2022-02-24
申请号:US17407795
申请日:2021-08-20
Applicant: Waymo LLC
Inventor: Ruizhongtai Qi , Yin Zhou , Dragomir Anguelov , Pei Sun
Abstract: Methods, computer systems, and apparatus, including computer programs encoded on computer storage media, for performing three-dimensional auto-labeling on sensor data. The system obtains a sensor data segment that includes a temporal sequence of three-dimensional point clouds generated from sensor readings of an environment by one or more sensors. The system identifies, from the sensor data segment, (i) a plurality of object tracks that each corresponds to a different object in the environment and (ii) for each object track, respective initial three-dimensional regions in each of one or more of the point clouds in which the corresponding object appears. The system generates, for each object track, extracted object track data that includes at least the points in the respective initial three-dimensional regions for the object track. The system further generates, for each object track and from the extracted object track data for the object track, an auto labeling output that defines respective refined three-dimensional regions in each of the one or more point clouds.
-
公开(公告)号:US20250076879A1
公开(公告)日:2025-03-06
申请号:US18951839
申请日:2024-11-19
Applicant: Waymo LLC
Inventor: Jared Stephen Russell , Jens-Steffen Ralf Gutmann , Pei Sun
Abstract: The technology relates controlling an autonomous vehicle through a multi-lane turn. In one example, data corresponding to a position of the autonomous vehicle in a lane of the multi-lane turn, a trajectory of the autonomous vehicle, and data corresponding to positions of objects in a vicinity of the autonomous vehicle may be received. A determination of whether the autonomous vehicle is positioned as a first vehicle in the lane or positioned behind another vehicle in the lane may be made based on a position of the autonomous vehicle in the lane relative to the positions of the objects. The trajectory of the autonomous vehicle through the lane may be adjusted based on whether the autonomous vehicle is positioned as a first vehicle in the lane or positioned behind another vehicle in the lane. The autonomous vehicle may be controlled based on the adjusted trajectory.
-
公开(公告)号:US12181886B2
公开(公告)日:2024-12-31
申请号:US17336938
申请日:2021-06-02
Applicant: Waymo LLC
Inventor: Jared Stephen Russell , Jens-Steffen Ralf Gutmann , Pei Sun
Abstract: The technology relates controlling an autonomous vehicle through a multi-lane turn. In one example, data corresponding to a position of the autonomous vehicle in a lane of the multi-lane turn, a trajectory of the autonomous vehicle, and data corresponding to positions of objects in a vicinity of the autonomous vehicle may be received. A determination of whether the autonomous vehicle is positioned as a first vehicle in the lane or positioned behind another vehicle in the lane may be made based on a position of the autonomous vehicle in the lane relative to the positions of the objects. The trajectory of the autonomous vehicle through the lane may be adjusted based on whether the autonomous vehicle is positioned as a first vehicle in the lane or positioned behind another vehicle in the lane. The autonomous vehicle may be controlled based on the adjusted trajectory.
-
公开(公告)号:US20240161398A1
公开(公告)日:2024-05-16
申请号:US18511566
申请日:2023-11-16
Applicant: Waymo LLC
Inventor: Tong He , Pei Sun , Zhaoqi Leng , Chenxi Liu , Mingxing Tan
CPC classification number: G06T17/00 , G01S17/89 , G06T7/194 , G06T7/20 , G06V10/44 , G06V10/82 , G06T2207/30241 , G06V2201/07
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating an output that characterizes a scene at a current time step. In one aspect, one of the systems include: a voxel neural network that generates a current early-stage feature representation of the current point cloud, a fusion subsystem that generates a current fused feature representation at the current time step; a backbone neural network that generates a current late-stage feature representation at the current time step, and an output neural network that generate an output that characterizes a scene at the current time step.
-
公开(公告)号:US11941875B2
公开(公告)日:2024-03-26
申请号:US17443674
申请日:2021-07-27
Applicant: Waymo LLC
Inventor: Yuning Chai , Pei Sun , Jiquan Ngiam , Weiyue Wang , Vijay Vasudevan , Benjamin James Caine , Xiao Zhang , Dragomir Anguelov
IPC: G06V20/00 , G01S7/48 , G01S17/89 , G06F18/21 , G06F18/213 , G06F18/25 , G06N3/08 , G06T7/70 , G06V10/94 , H04N23/10
CPC classification number: G06V20/00 , G01S7/4802 , G01S17/89 , G06F18/213 , G06F18/217 , G06F18/253 , G06N3/08 , G06T3/4046 , G06T7/70 , G06V10/95 , H04N23/10 , G06T2207/20084
Abstract: Methods, computer systems, and apparatus, including computer programs encoded on computer storage media, for processing a perspective view range image generated from sensor measurements of an environment. The perspective view range image includes a plurality of pixels arranged in a two-dimensional grid and including, for each pixel, (i) features of one or more sensor measurements at a location in the environment corresponding to the pixel and (ii) geometry information comprising range features characterizing a range of the location in the environment corresponding to the pixel relative to the one or more sensors. The system processes the perspective view range image using a first neural network to generate an output feature representation. The first neural network comprises a first perspective point-set aggregation layer comprising a geometry-dependent kernel.
-
19.
公开(公告)号:US20230351691A1
公开(公告)日:2023-11-02
申请号:US18120989
申请日:2023-03-13
Applicant: Waymo LLC
Inventor: Pei Sun , Mingxing Tan , Weiyue Wang , Fei Xia , Zhaoqi Leng , Dragomir Anguelov , Chenxi Liu
IPC: G06T17/20
CPC classification number: G06T17/20 , G06T2210/56
Abstract: Methods, systems, and apparatus for processing point clouds using neural networks to perform a machine learning task. In one aspect, a system comprises one or more computers configured to obtain a set of point clouds captured by one or more sensors. Each point cloud includes a respective plurality of three-dimensional points. The one or more computers assign the three-dimensional points to respective voxels in a voxel grid, where the grid of voxels includes non-empty voxels to which one or more points are assigned and empty voxels to which no points are assigned. For each non-empty voxel, the one or more computers generate initial features based on the points that are assigned to the non-empty voxel. The one or more computers generate multi-scale features of the voxel grid, and the one or more computers generate an output for a point cloud processing task using the multi-scale features of the voxel grid.
-
公开(公告)号:US20220169244A1
公开(公告)日:2022-06-02
申请号:US17540140
申请日:2021-12-01
Applicant: Waymo LLC
Inventor: Pei Sun , Hang Zhao , Alexander McCauley , Benjamin Sapp , Jiyang Gao , Dragomir Anguelov , Xin Huang , Kyriacos Christoforos Shiarlis
IPC: B60W30/095 , B60W60/00 , B60W50/00 , B60W40/04 , G06N3/04
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for agent trajectory prediction using temporal-spatial interaction predictions.
-
-
-
-
-
-
-
-
-