Trajectory representation in behavior prediction systems

    公开(公告)号:US11586213B2

    公开(公告)日:2023-02-21

    申请号:US17229384

    申请日:2021-04-13

    Applicant: Waymo LLC

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating a representation of a trajectory of a target agent in an environment. In one aspect, the representation of the trajectory of the target agent in the environment is a concatenation of a plurality of channels, where each channel is represented as a two-dimensional array of data values. Each position in each channel corresponds to a respective spatial position in the environment, and corresponding positions in different channels correspond to the same spatial position in the environment. The channels include a time channel and a respective motion channel corresponding to each motion parameter in a predetermined set of motion parameters.

    GENERATING TRAJECTORY LABELS FROM SHORT-TERM INTENTION AND LONG-TERM RESULT

    公开(公告)号:US20210200229A1

    公开(公告)日:2021-07-01

    申请号:US16727724

    申请日:2019-12-26

    Applicant: Waymo LLC

    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating training data for training a machine learning model to perform trajectory prediction. One of the methods includes: obtaining a training input, the training input including (i) data characterizing an agent in an environment as of a first time and (ii) data characterizing a candidate trajectory of the agent in the environment for a first time period that is after the first time. A long-term label for the candidate trajectory that indicates whether the agent actually followed the candidate trajectory for the first time period is determined. A short-term label for the candidate trajectory that indicates whether the agent intended to follow the candidate trajectory is determined. A ground-truth probability for the candidate trajectory is determined. The training input is associated with the ground-truth probability for the candidate trajectory in the training data.

    Agent prioritization for autonomous vehicles

    公开(公告)号:US11048253B2

    公开(公告)日:2021-06-29

    申请号:US16198130

    申请日:2018-11-21

    Applicant: Waymo LLC

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for identifying high-priority agents in the vicinity of a vehicle and, for only those agents which are high priority agents, generating data characterizing the agents using a first prediction model. In a first aspect, a system identifies multiple agents in an environment in a vicinity of a vehicle. The system generates a respective importance score for each of the agents by processing a feature representation of each agent using an importance scoring model. The importance score for an agent characterizes an estimated impact of the agent on planning decisions generated by a planning system of the vehicle which plans a future trajectory of the vehicle. The system identifies, as high-priority agents, a proper subset of the plurality of agents with the highest importance scores.

    Trajectory representation in behavior prediction systems

    公开(公告)号:US10739777B2

    公开(公告)日:2020-08-11

    申请号:US16196769

    申请日:2018-11-20

    Applicant: Waymo LLC

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating a representation of a trajectory of a target agent in an environment. In one aspect, the representation of the trajectory of the target agent in the environment is a concatenation of a plurality of channels, where each channel is represented as a two-dimensional array of data values. Each position in each channel corresponds to a respective spatial position in the environment, and corresponding positions in different channels correspond to the same spatial position in the environment. The channels include a time channel and a respective motion channel corresponding to each motion parameter in a predetermined set of motion parameters.

    AGENT PRIORITIZATION FOR AUTONOMOUS VEHICLES
    15.
    发明申请

    公开(公告)号:US20200159215A1

    公开(公告)日:2020-05-21

    申请号:US16198130

    申请日:2018-11-21

    Applicant: Waymo LLC

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for identifying high-priority agents in the vicinity of a vehicle and, for only those agents which are high priority agents, generating data characterizing the agents using a first prediction model. In a first aspect, a system identifies multiple agents in an environment in a vicinity of a vehicle. The system generates a respective importance score for each of the agents by processing a feature representation of each agent using an importance scoring model. The importance score for an agent characterizes an estimated impact of the agent on planning decisions generated by a planning system of the vehicle which plans a future trajectory of the vehicle. The system identifies, as high-priority agents, a proper subset of the plurality of agents with the highest importance scores.

    Determining respective impacts of agents

    公开(公告)号:US11829149B1

    公开(公告)日:2023-11-28

    申请号:US17750196

    申请日:2022-05-20

    Applicant: Waymo LLC

    CPC classification number: G05D1/0219 G01C21/3446 G01C21/3492 G05D1/0221

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining respective importance scores for a plurality of agents in a vicinity of an autonomous vehicle navigating through an environment. The respective importance scores characterize a relative impact of each agent on planned trajectories generated by a planning subsystem of the autonomous vehicle. In one aspect, a method comprises providing different states of an environment as input to the planning subsystem and obtaining as output from the planning subsystem corresponding planned trajectories. Importance scores for the one or more agents that are in one state but not in the other are determined based on a measure of difference between the planned trajectories.

    Training trajectory scoring neural networks to accurately assign scores

    公开(公告)号:US11586931B2

    公开(公告)日:2023-02-21

    申请号:US16671019

    申请日:2019-10-31

    Applicant: Waymo LLC

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training a neural network having a plurality of sub neural networks to assign respective confidence scores to one or more candidate future trajectories for an agent. Each confidence score indicates a predicted likelihood that the agent will move along the corresponding candidate future trajectory in the future. In one aspect, a method includes using the first sub neural network to generate a training intermediate representation; using the second sub neural network to generate respective training confidence scores; using a trajectory generation neural network to generate a training trajectory generation output; computing a first loss and a second loss; and determining an update to the current values of the parameters of the first and second sub neural networks.

    AGENT PRIORITIZATION FOR AUTONOMOUS VEHICLES

    公开(公告)号:US20210269023A1

    公开(公告)日:2021-09-02

    申请号:US17320727

    申请日:2021-05-14

    Applicant: Waymo LLC

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for identifying high-priority agents in the vicinity of a vehicle. In one aspect, a method comprises processing an input that characterizes a trajectory of the vehicle in an environment using an importance scoring model to generate an output that defines a respective importance score for each of a plurality of agents in the environment in the vicinity of the vehicle. The importance score for an agent characterizes an estimated impact of the agent on planning decisions generated by a planning system of the vehicle which plans a future trajectory of the vehicle. The high-priority agents are identified as a proper subset of the plurality of agents with the highest importance scores.

Patent Agency Ranking