-
公开(公告)号:US20240300542A1
公开(公告)日:2024-09-12
申请号:US18600159
申请日:2024-03-08
Applicant: Waymo LLC
Inventor: Ari Seff , Rami Al-Rfou , Angelo Brian Cera , Nigamaa Nayakanti , Aurick Qikun Zhou , Mason Ng , Benjamin Sapp , Dian Chen , Khaled Refaat
CPC classification number: B60W60/0027 , B60W50/0097 , B60W2420/00 , B60W2554/4044
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating trajectory predictions for one or more agents in an environment. In one aspect, a method comprises: obtaining scene context data characterizing a scene in an environment at a current time point and generating a respective predicted future trajectory for each of a plurality of agents in the scene at the current time point by sampling a sequence of discrete motion tokens that defines a joint future trajectory for the plurality of agents using a trajectory prediction neural network that is conditioned on the scene context data.
-
公开(公告)号:US20240149906A1
公开(公告)日:2024-05-09
申请号:US17387852
申请日:2021-07-28
Applicant: Waymo LLC
Inventor: Hang Zhao , Jiyang Gao , Chen Sun , Yi Shen , Yuning Chai , Cordelia Luise Schmid , Congcong Li , Benjamin Sapp , Dragomir Anguelov , Tian Lan , Yue Shen
CPC classification number: B60W60/001 , G06N3/02 , B60W2420/42 , B60W2554/4049
Abstract: Methods, computer systems, and apparatus, including computer programs encoded on computer storage media, for predicting future trajectories for an agent in an environment. A system obtains scene context data characterizing the environment. The scene context data includes data that characterizes a trajectory of an agent in a vicinity of a vehicle in an. environment up to a current time point. The system identifies a plurality of initial target locations in the environment. The system further generates, for each of a plurality of target locations that each corresponds to one of the initial target locations, a respective predicted likelihood score that represents a likelihood that the target location will be an intended final location for a future trajectory of the agent starting from the current time point. For each target location in a first subset of the target locations, the system generates a predicted future trajectory for the agent that is a prediction of the future trajectory of the agent given that the target location is the intended final location for the future trajectory. The system further selects, as likely future trajectories of the agent starting from the current time point, one or more of the predicted future trajectories.
-
公开(公告)号:US20230406361A1
公开(公告)日:2023-12-21
申请号:US18335920
申请日:2023-06-15
Applicant: Waymo LLC
Inventor: Wenjie Luo , Cheolho Park , Dragomir Anguelov , Benjamin Sapp
CPC classification number: B60W60/00272 , B60W50/0097 , B60W2554/4029 , B60W2554/4026 , B60W2554/4046
Abstract: Methods, systems, and apparatus for generating trajectory predictions for one or more agents. In one aspect, a system comprises one or more computers configured to obtain scene context data characterizing a scene in an environment at a current time point, where the scene includes multiple agents. The one or more computers process the scene context data using a marginal trajectory prediction neural network to generate a respective marginal trajectory prediction for each of the plurality of agents that defines multiple possible trajectories for the agent after the current time point and a respective likelihood score for each of the multiple possible future trajectories. The one or more computers can generate graph data based on the respective marginal trajectory predictions, and the one or more computers can process the graph data using a graph neural network to generate a joint trajectory prediction output for the multiple agents in the scene.
-
公开(公告)号:US20220169244A1
公开(公告)日:2022-06-02
申请号:US17540140
申请日:2021-12-01
Applicant: Waymo LLC
Inventor: Pei Sun , Hang Zhao , Alexander McCauley , Benjamin Sapp , Jiyang Gao , Dragomir Anguelov , Xin Huang , Kyriacos Christoforos Shiarlis
IPC: B60W30/095 , B60W60/00 , B60W50/00 , B60W40/04 , G06N3/04
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for agent trajectory prediction using temporal-spatial interaction predictions.
-
公开(公告)号:US12097889B2
公开(公告)日:2024-09-24
申请号:US18194882
申请日:2023-04-03
Applicant: Waymo LLC
Inventor: Yuning Chai , Benjamin Sapp , Mayank Bansal , Dragomir Anguelov
IPC: B60W60/00 , G06F18/214 , G06N3/08 , G06V10/82 , G06V20/56
CPC classification number: B60W60/00274 , G06F18/214 , G06N3/08 , G06V10/82 , G06V20/56 , G06V20/588 , B60W2554/4041 , B60W2554/4044
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for agent trajectory prediction using anchor trajectories.
-
公开(公告)号:US12049221B2
公开(公告)日:2024-07-30
申请号:US17540140
申请日:2021-12-01
Applicant: Waymo LLC
Inventor: Pei Sun , Hang Zhao , Alexander McCauley , Benjamin Sapp , Jiyang Gao , Dragomir Anguelov , Xin Huang , Kyriacos Christoforos Shiarlis
IPC: B60W30/095 , B60W40/04 , B60W50/00 , B60W60/00 , G06N3/049
CPC classification number: B60W30/0956 , B60W40/04 , B60W50/0097 , B60W60/00274 , G06N3/049
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for agent trajectory prediction using temporal-spatial interaction predictions.
-
公开(公告)号:US11987265B1
公开(公告)日:2024-05-21
申请号:US17387852
申请日:2021-07-28
Applicant: Waymo LLC
Inventor: Hang Zhao , Jiyang Gao , Chen Sun , Yi Shen , Yuning Chai , Cordelia Luise Schmid , Congcong Li , Benjamin Sapp , Dragomir Anguelov , Tian Lan , Yue Shen
CPC classification number: B60W60/001 , G06N3/02 , B60W2420/42 , B60W2554/4049
Abstract: A system obtains scene context data characterizing the environment. The scene context data includes data that characterizes a trajectory of an agent in a vicinity of a vehicle up to a current time point. The system identifies a plurality of initial target locations, and generates, for each of a plurality of target locations that each corresponds to one of the initial target locations, a respective predicted likelihood score that represents a likelihood that the target location will be an intended final location for a future trajectory of the agent. For each target location in a first subset of the target locations, the system generates a predicted future trajectory for the agent given that the target location is the intended final location for the future trajectory. The system further selects, as likely future trajectories of the agent, one or more of the predicted future trajectories.
-
公开(公告)号:US11926347B2
公开(公告)日:2024-03-12
申请号:US17514259
申请日:2021-10-29
Applicant: Waymo LLC
Inventor: Reza Mahjourian , Carlton Macdonald Downey , Benjamin Sapp , Dragomir Anguelov , Ekaterina Igorevna Tolstaya
CPC classification number: B60W60/00272 , B60W60/00274 , G06N3/045
Abstract: Methods, computer systems, and apparatus, including computer programs encoded on computer storage media, for performing a conditional behavior prediction for one or more agents. The system obtains context data characterizing an environment. The context data includes data characterizing a plurality of agents, including a query agent and one or more target agents, in the environment at a current time point. The system further obtains data identifying a planned future trajectory for the query agent after the current time point, and for each target agent in the set, processes the context data and the data identifying the planned future trajectory using a first neural network to generate a conditional trajectory prediction output that defines a conditional probability distribution over possible future trajectories of the target agent after the current time point given that the query agent follows the planned future trajectory for the query agent after the current time point.
-
19.
公开(公告)号:US20230280753A1
公开(公告)日:2023-09-07
申请号:US18118696
申请日:2023-03-07
Applicant: Waymo LLC
Inventor: Benjamin James Caine , Khaled Refaat , Benjamin Sapp , Scott Morgan Ettinger , Wei Chai , Rebecca Dawn Roelofs , Liting Sun
IPC: G05D1/02 , G06V20/54 , G06V10/82 , G06V10/774
CPC classification number: G05D1/0221 , G06V20/54 , G06V10/82 , G06V10/774
Abstract: Methods, systems, and apparatus for predicting future trajectories of agents in an environment. In one aspect, a system comprises one or more computers configured to receive a data set comprising multiple training examples. The training examples include scene data comprising respective agent data for multiple agents and a ground truth trajectory for a target agent that represents ground truth motion of the target agent after a corresponding time point. The one or more computers obtain data identifying one or more of the multiple agents as non-causal agents for each training example. A non-causal agent is an agent whose states do not cause the ground truth trajectory for the target agent to change. The one or more computers generate a respective modified training example from each of the multiple training examples.
-
公开(公告)号:US20220301182A1
公开(公告)日:2022-09-22
申请号:US17698930
申请日:2022-03-18
Applicant: Waymo LLC
Inventor: Reza Mahjourian , Jinkyu Kim , Yuning Chai , Mingxing Tan , Benjamin Sapp , Dragomir Anguelov
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for predicting the future movement of agents in an environment. In particular, the future movement is predicted through occupancy flow fields that specify, for each future time point in a sequence of future time points and for each agent type in a set of one or more agent types: an occupancy prediction for the future time step that specifies, for each grid cell, an occupancy likelihood that any agent of the agent type will occupy the grid cell at the future time point, and a motion flow prediction that specifies, for each grid cell, a motion vector that represents predicted motion of agents of the agent type within the grid cell at the future time point.
-
-
-
-
-
-
-
-
-