-
公开(公告)号:US20240157979A1
公开(公告)日:2024-05-16
申请号:US18511710
申请日:2023-11-16
Applicant: Waymo LLC
Inventor: Chiyu Jiang , Andre Liang Cornman , Cheolho Park , Benjamin Sapp , Yin Zhou , Dragomir Anguelov
CPC classification number: B60W60/00276 , B60W50/0097 , B60W50/06 , B60W2552/20 , B60W2554/4044 , B60W2556/10
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating trajectory predictions for one or more target agents, e.g., a vehicle, a cyclist, or a pedestrian, in an environment. In one aspect, one of the methods include: obtaining scene context data characterizing a scene at a current time point in an environment that includes multiple target agents; generating, from the scene context data, an encoded representation of the scene in the environment; and generating, by a diffusion model based on the encoded representation, a respective trajectory prediction output that predicts a respective future trajectory for each of the multiple target agents after the current time point.
-
公开(公告)号:US11618481B2
公开(公告)日:2023-04-04
申请号:US16919872
申请日:2020-07-02
Applicant: Waymo LLC
Inventor: Yuning Chai , Benjamin Sapp , Mayank Bansal , Dragomir Anguelov
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for agent trajectory prediction using anchor trajectories.
-
公开(公告)号:US20210001897A1
公开(公告)日:2021-01-07
申请号:US16919872
申请日:2020-07-02
Applicant: Waymo LLC
Inventor: Yuning Chai , Benjamin Sapp , Mayank Bansal , Dragomir Anguelov
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for agent trajectory prediction using anchor trajectories.
-
公开(公告)号:US20240278803A1
公开(公告)日:2024-08-22
申请号:US18423136
申请日:2024-01-25
Applicant: Waymo LLC
Inventor: Hang Zhao , Jiyang Gao , Chen Sun , Yi Shen , Yuning Chai , Cordelia Luise Schmid , Congcong Li , Benjamin Sapp , Dragomir Anguelov , Tian Lan , Yue Shen
CPC classification number: B60W60/001 , G06N3/02 , B60W2420/403 , B60W2554/4049
Abstract: Methods, computer systems, and apparatus, including computer programs encoded on computer storage media, for predicting future trajectories for an agent in an environment. A system obtains scene context data characterizing the environment. The scene context data includes data that characterizes a trajectory of an agent in a vicinity of a vehicle in an environment up to a current time point. The system identifies a plurality of initial target locations in the environment. The system further generates, for each of a plurality of target locations that each corresponds to one of the initial target locations, a respective predicted likelihood score that represents a likelihood that the target location will be an intended final location for a future trajectory of the agent starting from the current time point. For each target location in a first subset of the target locations, the system generates a predicted future trajectory for the agent that is a prediction of the future trajectory of the agent given that the target location is the intended final location for the future trajectory. The system further selects, as likely future trajectories of the agent starting from the current time point, one or more of the predicted future trajectories.
-
公开(公告)号:US20230234616A1
公开(公告)日:2023-07-27
申请号:US18194882
申请日:2023-04-03
Applicant: Waymo LLC
Inventor: Yuning Chai , Benjamin Sapp , Mayank Bansal , Dragomir Anguelov
IPC: B60W60/00 , G06N3/08 , G06V20/56 , G06F18/214 , G06V10/82
CPC classification number: B60W60/00274 , G06N3/08 , G06V20/588 , G06F18/214 , G06V10/82 , G06V20/56 , B60W2554/4044 , B60W2554/4041
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for agent trajectory prediction using anchor trajectories.
-
公开(公告)号:US20220297728A1
公开(公告)日:2022-09-22
申请号:US17700348
申请日:2022-03-21
Applicant: Waymo LLC
Inventor: Balakrishnan Varadarajan , Ahmed Said Mohammed Hefny , Benjamin Sapp , Khaled Refaat , Dragomir Anguelov
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for agent trajectory prediction using context-sensitive fusion.
-
公开(公告)号:US20220155096A1
公开(公告)日:2022-05-19
申请号:US17527676
申请日:2021-11-16
Applicant: Waymo LLC
Inventor: Jinkyu Kim , Reza Mahjourian , Scott Morgan Ettinger , Brandyn Allen White , Benjamin Sapp
Abstract: Methods, computer systems, and apparatus, including computer programs encoded on computer storage media, for generating a prediction that characterizes an environment. The system obtains an input including data characterizing observed trajectories one or more agents and data characterizing one or more map features identified in a map of the environment. The system generates, from the input, an encoder input that comprises representations for each of a plurality of points in a top-down representation of the environment. The system processes the encoder input using a point cloud encoder neural network to generate a global feature map of the environment, and processes a prediction input including the global feature map using a predictor neural network to generate a prediction output characterizing the environment.
-
公开(公告)号:US12299898B2
公开(公告)日:2025-05-13
申请号:US17698930
申请日:2022-03-18
Applicant: Waymo LLC
Inventor: Reza Mahjourian , Jinkyu Kim , Yuning Chai , Mingxing Tan , Benjamin Sapp , Dragomir Anguelov
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for predicting the future movement of agents in an environment. In particular, the future movement is predicted through occupancy flow fields that specify, for each future time point in a sequence of future time points and for each agent type in a set of one or more agent types: an occupancy prediction for the future time step that specifies, for each grid cell, an occupancy likelihood that any agent of the agent type will occupy the grid cell at the future time point, and a motion flow prediction that specifies, for each grid cell, a motion vector that represents predicted motion of agents of the agent type within the grid cell at the future time point.
-
公开(公告)号:US20250121857A1
公开(公告)日:2025-04-17
申请号:US18913074
申请日:2024-10-11
Applicant: Waymo LLC
Inventor: Bertrand Robert Douillard , Aurick Qikun Zhou , Rami Al-Rfou , Kratarth Goel , Benjamin Sapp , Andre Liang Cornman , Cheolho Park , Lingyun Liu
Abstract: A method performed by one or more computers, the method comprising: obtaining scene context data characterizing a scene in an environment at a current time point, wherein the scene context data includes features of the scene in a scene-centric coordinate system; generating a scene-centric encoded representation of the scene in the environment by processing the scene context data using an encoder neural network; for each target agent: obtaining agent-specific features for the target agent, processing the agent-specific features for the target agent and the scene-centric encoded representation of the scene using a fusion neural network to generate a fused scene representation for the target agent, and processing the fused scene representation for the target agent using a decoder neural network to generate a trajectory prediction output for the target agent in an agent-centric coordinate system for the target agent.
-
公开(公告)号:US20230406360A1
公开(公告)日:2023-12-21
申请号:US18335915
申请日:2023-06-15
Applicant: Waymo LLC
Inventor: Rami Al-Rfou , Nigamaa Nayakanti , Kratarth Goel , Aurick Qikun Zhou , Benjamin Sapp , Khaled Refaat
IPC: B60W60/00 , B60W40/06 , B60W40/04 , G06N3/0455
CPC classification number: B60W60/0027 , B60W40/06 , B60W2556/10 , G06N3/0455 , B60W40/04
Abstract: Methods, systems, and apparatus for generating trajectory predictions for one or more target agents. In one aspect, a system comprises one or more computers configured to obtain scene context data characterizing a scene in an environment at a current time point, where the scene includes multiple agents that include a target agent and one or more context agents, and the scene context data includes respective context data for each of multiple different modalities of context data. The one or more computers then generate an encoded representation of the scene in the environment that includes one or more embeddings and process the encoded representation of the scene context data using a decoder neural network to generate a trajectory prediction output for the target agent that predicts a future trajectory of the target after the current time point.
-
-
-
-
-
-
-
-
-