-
公开(公告)号:US20240157979A1
公开(公告)日:2024-05-16
申请号:US18511710
申请日:2023-11-16
Applicant: Waymo LLC
Inventor: Chiyu Jiang , Andre Liang Cornman , Cheolho Park , Benjamin Sapp , Yin Zhou , Dragomir Anguelov
CPC classification number: B60W60/00276 , B60W50/0097 , B60W50/06 , B60W2552/20 , B60W2554/4044 , B60W2556/10
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating trajectory predictions for one or more target agents, e.g., a vehicle, a cyclist, or a pedestrian, in an environment. In one aspect, one of the methods include: obtaining scene context data characterizing a scene at a current time point in an environment that includes multiple target agents; generating, from the scene context data, an encoded representation of the scene in the environment; and generating, by a diffusion model based on the encoded representation, a respective trajectory prediction output that predicts a respective future trajectory for each of the multiple target agents after the current time point.
-
公开(公告)号:US11670038B2
公开(公告)日:2023-06-06
申请号:US17516073
申请日:2021-11-01
Applicant: Waymo LLC
Inventor: Yin Zhou , Pei Sun , Yu Zhang , Dragomir Anguelov , Jiyang Gao , Yu Ouyang , Zijian Guo , Jiquan Ngiam , Vijay Vasudevan
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing point cloud data using dynamic voxelization. When deployed within an on-board system of a vehicle, processing the point cloud data using dynamic voxelization can be used to make autonomous driving decisions for the vehicle with enhanced accuracy, for example by combining representations of point cloud data characterizing a scene from multiple views of the scene.
-
公开(公告)号:US20220230387A1
公开(公告)日:2022-07-21
申请号:US17713108
申请日:2022-04-04
Applicant: Waymo LLC
Inventor: Yin Zhou , Dragomir Anguelov , Zhangjie Cao
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating realistic full-scene point clouds. One of the methods includes obtaining an initial scene point cloud characterizing an initial scene in an environment; obtaining, for each of one or more objects, an object point cloud that characterizes the object;
and processing a first input comprising the initial scene point cloud and the one or more object point clouds using a first neural network that is configured to process the first input to generate a final scene point cloud that characterizes a transformed scene that has the one or more objects added to the initial scene.-
公开(公告)号:US20220156965A1
公开(公告)日:2022-05-19
申请号:US17505900
申请日:2021-10-20
Applicant: Waymo LLC
Inventor: Jingxiao Zheng , Xinwei Shi , Alexander Gorban , Junhua Mao , Andre Liang Cornman , Yang Song , Ting Liu , Ruizhongtai Qi , Yin Zhou , Congcong Li , Dragomir Anguelov
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for estimating a 3-D pose of an object of interest from image and point cloud data. In one aspect, a method includes obtaining an image of an environment; obtaining a point cloud of a three-dimensional region of the environment; generating a fused representation of the image and the point cloud; and processing the fused representation using a pose estimation neural network and in accordance with current values of a plurality of pose estimation network parameters to generate a pose estimation network output that specifies, for each of multiple keypoints, a respective estimated position in the three-dimensional region of the environment.
-
公开(公告)号:US20220058858A1
公开(公告)日:2022-02-24
申请号:US17516073
申请日:2021-11-01
Applicant: Waymo LLC
Inventor: Yin Zhou , Pei Sun , Yu Zhang , Dragomir Anguelov , Jiyang Gao , Yu Ouyang , Zijian Guo , Jiquan Ngiam , Vijay Vasudevan
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing point cloud data using dynamic voxelization. When deployed within an on-board system of a vehicle, processing the point cloud data using dynamic voxelization can be used to make autonomous driving decisions for the vehicle with enhanced accuracy, for example by combining representations of point cloud data characterizing a scene from multiple views of the scene.
-
公开(公告)号:US20210150807A1
公开(公告)日:2021-05-20
申请号:US17099589
申请日:2020-11-16
Applicant: Waymo LLC
Inventor: Yin Zhou , Dragomir Anguelov , Zhangjie Cao
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating realistic full-scene point clouds. One of the methods includes obtaining an initial scene point cloud characterizing an initial scene in an environment; obtaining, for each of one or more objects, an object point cloud that characterizes the object; and processing a first input comprising the initial scene point cloud and the one or more object point clouds using a first neural network that is configured to process the first input to generate a final scene point cloud that characterizes a transformed scene that has the one or more objects added to the initial scene.
-
公开(公告)号:US12154212B2
公开(公告)日:2024-11-26
申请号:US17098943
申请日:2020-11-16
Applicant: Waymo LLC
Inventor: Zhenpei Yang , Yuning Chai , Yin Zhou , Pei Sun , Henrik Kretzschmar , Sean Rafferty , Dumitru Erhan , Dragomir Anguelov
IPC: G06T17/05 , B60W30/095 , B60W50/06 , B60W60/00 , G06N3/045 , G06N3/08 , G06T7/70 , G06T9/00 , G06T15/00 , G06T15/04
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generated simulated sensor data. One of the methods includes obtaining a surfel map generated from sensor observations of a real-world environment and generating, for each surfel in the surfel map, a respective grid having a plurality of grid cells, wherein each grid has an orientation matching an orientation of a corresponding surfel, and wherein each grid cell within each grid is assigned a respective color value. For a simulated location within a simulated representation of the real-world environment, a textured surfel rendering is generated, including combining color information from grid cells visible from the simulated location within the simulated representation of the real-world environment.
-
公开(公告)号:US11967103B2
公开(公告)日:2024-04-23
申请号:US17505900
申请日:2021-10-20
Applicant: Waymo LLC
Inventor: Jingxiao Zheng , Xinwei Shi , Alexander Gorban , Junhua Mao , Andre Liang Cornman , Yang Song , Ting Liu , Ruizhongtai Qi , Yin Zhou , Congcong Li , Dragomir Anguelov
IPC: G06T7/73 , G06F18/214 , G06F18/25 , G06V20/58
CPC classification number: G06T7/73 , G06F18/214 , G06F18/251 , G06V20/58 , G06T2207/10028 , G06T2207/20081 , G06T2207/20084 , G06T2207/30196 , G06T2207/30261
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for estimating a 3-D pose of an object of interest from image and point cloud data. In one aspect, a method includes obtaining an image of an environment; obtaining a point cloud of a three-dimensional region of the environment; generating a fused representation of the image and the point cloud; and processing the fused representation using a pose estimation neural network and in accordance with current values of a plurality of pose estimation network parameters to generate a pose estimation network output that specifies, for each of multiple keypoints, a respective estimated position in the three-dimensional region of the environment.
-
公开(公告)号:US20240096076A1
公开(公告)日:2024-03-21
申请号:US17945325
申请日:2022-09-15
Applicant: Waymo LLC
Inventor: Yin Zhou , Ruizhongtai Qi , Dragomir Anguelov , Minghua Liu , Boqing Gong
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training a semantic segmentation neural network for point clouds. One of the methods includes: obtaining a plurality of training points divided into a respective plurality of components; obtaining, for each of the respective plurality of components, data identifying a ground truth category for one or more labeled point; processing each training points using a semantic segmentation neural network to generate a semantic segmentation that includes a respective score for each of the plurality of categories; determining a gradient of a loss function that penalizes the semantic segmentation neural network for generating, for points in the component, non-zero scores for categories that are not the ground truth category for any labeled point in the component; and updating, using the gradient, the parameters of the semantic segmentation neural network.
-
公开(公告)号:US20220058818A1
公开(公告)日:2022-02-24
申请号:US17407795
申请日:2021-08-20
Applicant: Waymo LLC
Inventor: Ruizhongtai Qi , Yin Zhou , Dragomir Anguelov , Pei Sun
Abstract: Methods, computer systems, and apparatus, including computer programs encoded on computer storage media, for performing three-dimensional auto-labeling on sensor data. The system obtains a sensor data segment that includes a temporal sequence of three-dimensional point clouds generated from sensor readings of an environment by one or more sensors. The system identifies, from the sensor data segment, (i) a plurality of object tracks that each corresponds to a different object in the environment and (ii) for each object track, respective initial three-dimensional regions in each of one or more of the point clouds in which the corresponding object appears. The system generates, for each object track, extracted object track data that includes at least the points in the respective initial three-dimensional regions for the object track. The system further generates, for each object track and from the extracted object track data for the object track, an auto labeling output that defines respective refined three-dimensional regions in each of the one or more point clouds.
-
-
-
-
-
-
-
-
-