-
公开(公告)号:US11950166B2
公开(公告)日:2024-04-02
申请号:US16847528
申请日:2020-04-13
Applicant: Waymo LLC
Inventor: Khaled Refaat , Kai Ding
IPC: H04W4/02 , G06F18/214 , G06F18/2321 , G06N3/044 , G06N3/045 , G06N3/047 , G06N3/049 , G06N3/08 , G06N20/00 , G06V10/764 , G06V10/82 , G06V20/56 , H04W4/029
CPC classification number: H04W4/027 , G06F18/214 , G06F18/2321 , G06N3/044 , G06N3/045 , G06N3/047 , G06N3/049 , G06N3/08 , G06N20/00 , G06V10/764 , G06V10/82 , G06V20/56 , H04W4/029
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for determining occupancies of surrounding agents. One of the methods includes obtaining scene data characterizing an environment at a current time point; processing a first network input generated from the scene data using a first neural network to generate an intermediate output; obtaining an identification of a future time point that is after the current time point; and generating, from the intermediate output and the future time point, an occupancy output, wherein the occupancy output comprises respective occupancy probabilities for each of a plurality of locations in the environment, wherein the respective occupancy probability for each location characterizes a likelihood that one or more agents will occupy the location at the future time point.
-
公开(公告)号:US11851081B2
公开(公告)日:2023-12-26
申请号:US17108626
申请日:2020-12-01
Applicant: Waymo LLC
Inventor: Khaled Refaat , Haoyu Chen , Wei Chai , Alisha Saxena
IPC: B60W60/00 , G06K9/62 , G06K9/00 , G06N3/08 , G06V20/56 , G06F18/214 , G06F18/2415
CPC classification number: B60W60/001 , G06F18/214 , G06F18/2415 , G06N3/08 , G06V20/56
Abstract: Data representing a set of predicted trajectories and a planned trajectory for an autonomous vehicle is obtained. A predictability score for the planned trajectory can be determined based on a comparison of the planned trajectory to the set of predicted trajectories for the autonomous vehicle. The predictability score indicates a level of predictability of the planned trajectory. A determination can be made, based at least on the predictability score, whether to initiate travel with the autonomous vehicle along the planned trajectory. In response to determining to initiate travel with the autonomous vehicle along the planned trajectory, a control system can be directed to maneuver the autonomous vehicle along the planned trajectory.
-
公开(公告)号:US11829149B1
公开(公告)日:2023-11-28
申请号:US17750196
申请日:2022-05-20
Applicant: Waymo LLC
Inventor: Khaled Refaat , Kai Ding , Stephane Ross
CPC classification number: G05D1/0219 , G01C21/3446 , G01C21/3492 , G05D1/0221
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining respective importance scores for a plurality of agents in a vicinity of an autonomous vehicle navigating through an environment. The respective importance scores characterize a relative impact of each agent on planned trajectories generated by a planning subsystem of the autonomous vehicle. In one aspect, a method comprises providing different states of an environment as input to the planning subsystem and obtaining as output from the planning subsystem corresponding planned trajectories. Importance scores for the one or more agents that are in one state but not in the other are determined based on a measure of difference between the planned trajectories.
-
公开(公告)号:US20230288929A1
公开(公告)日:2023-09-14
申请号:US18197561
申请日:2023-05-15
Applicant: Waymo LLC
Inventor: Kai Ding , Minfa Wang , Haoyu Chen , Khaled Refaat , Stephane Ross , Wei Chai
CPC classification number: G05D1/0088 , G05D1/0214 , G06N3/08 , G05D2201/0213
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for identifying high-priority agents in the vicinity of a vehicle. The high-priority agents can be identified based on a set of mutual importance scores in which each mutual importance score indicates an estimated mutual relevance between the vehicle and a different agent from a set of agents on planning decisions of the other. The mutual importance scores can be calculated based on importance scores assessed from the perspectives of both the vehicle and the agents.
-
公开(公告)号:US11687077B2
公开(公告)日:2023-06-27
申请号:US16987980
申请日:2020-08-07
Applicant: Waymo LLC
Inventor: Kai Ding , Minfa Wang , Haoyu Chen , Khaled Refaat , Stephane Ross , Wei Chai
CPC classification number: G05D1/0088 , G05D1/0214 , G06N3/08 , G05D2201/0213
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for identifying high-priority agents in the vicinity of a vehicle. The high-priority agents can be identified based on a set of mutual importance scores in which each mutual importance score indicates an estimated mutual relevance between the vehicle and a different agent from a set of agents on planning decisions of the other. The mutual importance scores can be calculated based on importance scores assessed from the perspectives of both the vehicle and the agents.
-
公开(公告)号:US11586931B2
公开(公告)日:2023-02-21
申请号:US16671019
申请日:2019-10-31
Applicant: Waymo LLC
Inventor: Khaled Refaat , Kai Ding , Stephane Ross
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training a neural network having a plurality of sub neural networks to assign respective confidence scores to one or more candidate future trajectories for an agent. Each confidence score indicates a predicted likelihood that the agent will move along the corresponding candidate future trajectory in the future. In one aspect, a method includes using the first sub neural network to generate a training intermediate representation; using the second sub neural network to generate respective training confidence scores; using a trajectory generation neural network to generate a training trajectory generation output; computing a first loss and a second loss; and determining an update to the current values of the parameters of the first and second sub neural networks.
-
公开(公告)号:US20220297728A1
公开(公告)日:2022-09-22
申请号:US17700348
申请日:2022-03-21
Applicant: Waymo LLC
Inventor: Balakrishnan Varadarajan , Ahmed Said Mohammed Hefny , Benjamin Sapp , Khaled Refaat , Dragomir Anguelov
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for agent trajectory prediction using context-sensitive fusion.
-
公开(公告)号:US20220161824A1
公开(公告)日:2022-05-26
申请号:US17101842
申请日:2020-11-23
Applicant: Waymo LLC
Inventor: Khaled Refaat
IPC: B60W60/00 , G01S17/931 , G01S17/58 , G01S13/931 , G01S13/58
Abstract: An autonomous vehicle includes sensor subsystem(s) that output a sensor signal. A perception subsystem (i) detects an agent in a vicinity of the autonomous vehicle and (ii) generates a motion signal that describes at least one of a past motion or a present motion of the agent. An intention prediction subsystem processes the sensor signal to generate an intention signal that describes at least one intended action of the agent. A behavior prediction subsystem processes the motion signal and the intention signal to generate a behavior prediction signal that describes at least one predicted behavior of the agent. A planner subsystem processes the behavior prediction signal to plan a driving decision for the autonomous vehicle.
-
公开(公告)号:US20210269023A1
公开(公告)日:2021-09-02
申请号:US17320727
申请日:2021-05-14
Applicant: Waymo LLC
Inventor: Kai Ding , Khaled Refaat , Stephane Ross
IPC: B60W30/095 , G05D1/02 , G05D1/00
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for identifying high-priority agents in the vicinity of a vehicle. In one aspect, a method comprises processing an input that characterizes a trajectory of the vehicle in an environment using an importance scoring model to generate an output that defines a respective importance score for each of a plurality of agents in the environment in the vicinity of the vehicle. The importance score for an agent characterizes an estimated impact of the agent on planning decisions generated by a planning system of the vehicle which plans a future trajectory of the vehicle. The high-priority agents are identified as a proper subset of the plurality of agents with the highest importance scores.
-
公开(公告)号:US11003189B2
公开(公告)日:2021-05-11
申请号:US16922798
申请日:2020-07-07
Applicant: Waymo LLC
Inventor: Khaled Refaat , Stephane Ross
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating a representation of a trajectory of a target agent in an environment. In one aspect, the representation of the trajectory of the target agent in the environment is a concatenation of a plurality of channels, where each channel is represented as a two-dimensional array of data values. Each position in each channel corresponds to a respective spatial position in the environment, and corresponding positions in different channels correspond to the same spatial position in the environment. The channels include a time channel and a respective motion channel corresponding to each motion parameter in a predetermined set of motion parameters.
-
-
-
-
-
-
-
-
-