-
公开(公告)号:US20220135086A1
公开(公告)日:2022-05-05
申请号:US17514259
申请日:2021-10-29
Applicant: Waymo LLC
Inventor: Reza Mahjourian , Carlton Macdonald Downey , Benjamin Sapp , Dragomir Anguelov , Ekaterina Igorevna Tolstaya
Abstract: Methods, computer systems, and apparatus, including computer programs encoded on computer storage media, for performing a conditional behavior prediction for one or more agents. The system obtains context data characterizing an environment. The context data includes data characterizing a plurality of agents, including a query agent and one or more target agents, in the environment at a current time point. The system further obtains data identifying a planned future trajectory for the query agent after the current time point, and for each target agent in the set, processes the context data and the data identifying the planned future trajectory using a first neural network to generate a conditional trajectory prediction output that defines a conditional probability distribution over possible future trajectories of the target agent after the current time point given that the query agent follows the planned future trajectory for the query agent after the current time point.
-
公开(公告)号:US20210390407A1
公开(公告)日:2021-12-16
申请号:US17344254
申请日:2021-06-10
Applicant: Waymo LLC
Inventor: Vincent Michael Casser , Yuning Chai , Dragomir Anguelov , Hang Zhao , Henrik Kretzschmar , Reza Mahjourian , Anelia Angelova , Ariel Gordon , Soeren Pirk
Abstract: Methods, computer systems, and apparatus, including computer programs encoded on computer storage media, for training a perspective computer vision model. The model is configured to receive input data characterizing an input scene in an environment from an input viewpoint and to process the input data in accordance with a set of model parameters to generate an output perspective representation of the scene from the input viewpoint. The system trains the model based on first data characterizing a scene in the environment from a first viewpoint and second data characterizing the scene in the environment from a second, different viewpoint.
-
公开(公告)号:US11164363B2
公开(公告)日:2021-11-02
申请号:US16924080
申请日:2020-07-08
Applicant: Waymo LLC
Inventor: Yin Zhou , Pei Sun , Yu Zhang , Dragomir Anguelov , Jiyang Gao , Yu Ouyang , Zijian Guo , Jiquan Ngiam , Vijay Vasudevan
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing point cloud data using dynamic voxelization. When deployed within an on-board system of a vehicle, processing the point cloud data using dynamic voxelization can be used to make autonomous driving decisions for the vehicle with enhanced accuracy, for example by combining representations of point cloud data characterizing a scene from multiple views of the scene.
-
公开(公告)号:US20250037303A1
公开(公告)日:2025-01-30
申请号:US18614254
申请日:2024-03-22
Applicant: Waymo LLC
Inventor: Jingxiao Zheng , Xinwei Shi , Alexander Gorban , Junhua Mao , Andre Liang Cornman , Yang Song , Ting Liu , Ruizhongtai Qi , Yin Zhou , Congcong Li , Dragomir Anguelov
IPC: G06T7/73 , G06F18/214 , G06F18/25 , G06V20/58
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for estimating a 3-D pose of an object of interest from image and point cloud data. In one aspect, a method includes obtaining an image of an environment; obtaining a point cloud of a three-dimensional region of the environment; generating a fused representation of the image and the point cloud; and processing the fused representation using a pose estimation neural network and in accordance with current values of a plurality of pose estimation network parameters to generate a pose estimation network output that specifies, for each of multiple keypoints, a respective estimated position in the three-dimensional region of the environment.
-
公开(公告)号:US12125298B2
公开(公告)日:2024-10-22
申请号:US17527653
申请日:2021-11-16
Applicant: Waymo LLC
Inventor: Pei Sun , Weiyue Wang , Yuning Chai , Xiao Zhang , Dragomir Anguelov
CPC classification number: G06V20/64 , G06T7/194 , G06T2207/10028 , G06T2207/20081 , G06T2207/20084
Abstract: Methods, computer systems, and apparatus, including computer programs encoded on computer storage media, for performing object detection. The system obtains a respective range image corresponding to each point cloud in a set of point clouds captured by one or more sensors. The system processes each range image using a segmentation neural network to generate range image features and a segmentation output. The system generates a feature representation of the set of point clouds from only the feature representations of the foreground points. The system processes the feature representation of the set of point clouds using a prediction neural network to generate a prediction characterizing the set of point clouds.
-
公开(公告)号:US12073575B2
公开(公告)日:2024-08-27
申请号:US17407795
申请日:2021-08-20
Applicant: Waymo LLC
Inventor: Ruizhongtai Qi , Yin Zhou , Dragomir Anguelov , Pei Sun
CPC classification number: G06T7/521 , G06T7/20 , G06T2207/10028 , G06T2207/20084
Abstract: Methods, computer systems, and apparatus, including computer programs encoded on computer storage media, for performing three-dimensional auto-labeling on sensor data. The system obtains a sensor data segment that includes a temporal sequence of three-dimensional point clouds generated from sensor readings of an environment by one or more sensors. The system identifies, from the sensor data segment, (i) a plurality of object tracks that each corresponds to a different object in the environment and (ii) for each object track, respective initial three-dimensional regions in each of one or more of the point clouds in which the corresponding object appears. The system generates, for each object track, extracted object track data that includes at least the points in the respective initial three-dimensional regions for the object track. The system further generates, for each object track and from the extracted object track data for the object track, an auto labeling output that defines respective refined three-dimensional regions in each of the one or more point clouds.
-
公开(公告)号:US20240278803A1
公开(公告)日:2024-08-22
申请号:US18423136
申请日:2024-01-25
Applicant: Waymo LLC
Inventor: Hang Zhao , Jiyang Gao , Chen Sun , Yi Shen , Yuning Chai , Cordelia Luise Schmid , Congcong Li , Benjamin Sapp , Dragomir Anguelov , Tian Lan , Yue Shen
CPC classification number: B60W60/001 , G06N3/02 , B60W2420/403 , B60W2554/4049
Abstract: Methods, computer systems, and apparatus, including computer programs encoded on computer storage media, for predicting future trajectories for an agent in an environment. A system obtains scene context data characterizing the environment. The scene context data includes data that characterizes a trajectory of an agent in a vicinity of a vehicle in an environment up to a current time point. The system identifies a plurality of initial target locations in the environment. The system further generates, for each of a plurality of target locations that each corresponds to one of the initial target locations, a respective predicted likelihood score that represents a likelihood that the target location will be an intended final location for a future trajectory of the agent starting from the current time point. For each target location in a first subset of the target locations, the system generates a predicted future trajectory for the agent that is a prediction of the future trajectory of the agent given that the target location is the intended final location for the future trajectory. The system further selects, as likely future trajectories of the agent starting from the current time point, one or more of the predicted future trajectories.
-
公开(公告)号:US20230343107A1
公开(公告)日:2023-10-26
申请号:US18216488
申请日:2023-06-29
Applicant: Waymo LLC
Inventor: Mayank Bansal , Dragomir Anguelov
CPC classification number: G06V20/58 , B60W60/00274 , B60W60/00259 , G06V20/10 , G06N3/045 , G06N3/047 , G06V10/764 , G06V10/82
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for predicting occupancies of agents. One of the methods includes obtaining scene data characterizing a current scene in an environment; and processing a neural network input comprising the scene data using a neural network to generate a neural network output, wherein: the neural network output comprises respective occupancy outputs corresponding to a plurality of agent types at one or more future time points; the occupancy output for each agent type at a first future time point comprises respective occupancy probabilities for a plurality of locations in the environment; and in the occupancy output for each agent type at the first future time point, the respective occupancy probability for each location characterizes a likelihood that an agent of the agent type will occupy the location at the first future time point.
-
公开(公告)号:US20230234616A1
公开(公告)日:2023-07-27
申请号:US18194882
申请日:2023-04-03
Applicant: Waymo LLC
Inventor: Yuning Chai , Benjamin Sapp , Mayank Bansal , Dragomir Anguelov
IPC: B60W60/00 , G06N3/08 , G06V20/56 , G06F18/214 , G06V10/82
CPC classification number: B60W60/00274 , G06N3/08 , G06V20/588 , G06F18/214 , G06V10/82 , G06V20/56 , B60W2554/4044 , B60W2554/4041
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for agent trajectory prediction using anchor trajectories.
-
公开(公告)号:US20230076479A1
公开(公告)日:2023-03-09
申请号:US17819883
申请日:2022-08-15
Applicant: Waymo LLC
Inventor: Dragomir Anguelov , Colin Andrew Braley , Christoph Sprunk
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for the generation and use of a surfel map with semantic labels. One of the methods includes receiving a surfel map that includes a plurality of surfels, wherein each surfel has associated data that includes one or more semantic labels; obtaining sensor data for one or more locations in the environment, the sensor data having been captured by one or more sensors of a first vehicle; determining one or more surfels corresponding to the one or more locations of the obtained sensor data; identifying one or more semantic labels for the one or more surfels corresponding to the one or more locations of the obtained sensor data; and performing, for each surfel corresponding to the one or more locations of the obtained sensor data, a label-specific detection process for the surfel.
-
-
-
-
-
-
-
-
-