TRAJECTORY PREDICTION FROM MULTI-SENSOR FUSION

    公开(公告)号:US20250162618A1

    公开(公告)日:2025-05-22

    申请号:US18517750

    申请日:2023-11-22

    Applicant: Waymo LLC

    Abstract: Methods and systems for predicting a trajectory an autonomous vehicle (AV) are disclosed. A method includes generating, based on sensor data from a sensing system of the AV, one or more embeddings, generating, using a machine learning model (MLM) and the one or more embeddings, one or more predicted future trajectories for the AV, and causing, using the one or more predicted future trajectories, a planning system of the AV to generate an update to a current trajectory of the AV.

    Three-dimensional location prediction from images

    公开(公告)号:US12299916B2

    公开(公告)日:2025-05-13

    申请号:US17545987

    申请日:2021-12-08

    Applicant: Waymo LLC

    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for predicting three-dimensional object locations from images. One of the methods includes obtaining a sequence of images that comprises, at each of a plurality of time steps, a respective image that was captured by a camera at the time step; generating, for each image in the sequence, respective pseudo-lidar features of a respective pseudo-lidar representation of a region in the image that has been determined to depict a first object; generating, for a particular image at a particular time step in the sequence, image patch features of the region in the particular image that has been determined to depict the first object; and generating, from the respective pseudo-lidar features and the image patch features, a prediction that characterizes a location of the first object in a three-dimensional coordinate system at the particular time step in the sequence.

    END-TO-END PROCESSING IN AUTOMATED DRIVING SYSTEMS

    公开(公告)号:US20230294687A1

    公开(公告)日:2023-09-21

    申请号:US18169105

    申请日:2023-02-14

    Applicant: Waymo LLC

    Abstract: The described aspects and implementations enable efficient object detection and tracking. In one implementation, disclosed is a method and a system to perform the method, the system including the sensing system configured to obtain sensing data characterizing an environment of the vehicle. The system further includes a data processing system operatively coupled to the sensing system and configured to process the sensing data using a first (second) set of neural network (NN) layers to obtain a first (second) set of features for a first (second) region of the environment, the first (second) set of features is associated with a first (second) spatial resolution. The data processing system is further to process the two sets of features using a second set of NN layers to detect a location of obj ect(s) in the environment of the vehicle and a state of motion of the object(s).

    Object Action Classification For Autonomous Vehicles

    公开(公告)号:US20210294346A1

    公开(公告)日:2021-09-23

    申请号:US17343187

    申请日:2021-06-09

    Applicant: Waymo LLC

    Abstract: Aspects of the disclosure relate to training and using a model for identifying actions of objects. For instance, LIDAR sensor data frames including an object bounding box corresponding to an object as well as an action label for the bounding box may be received. Each sensor frame is associated with a timestamp and is sequenced with respect to other sensor frames. Each given sensor data frame may be projected into a camera image of the object based on the timestamp associated with the given sensor data frame in order to provide fused data. The model may be trained using the fused data such that the model is configured to, in response to receiving fused data, the model outputs an action label for each object bounding box of the fused data. This output may then be used to control a vehicle in an autonomous driving mode.

    AUTOMATIC LABELING OF OBJECTS IN SENSOR DATA

    公开(公告)号:US20250103844A1

    公开(公告)日:2025-03-27

    申请号:US18973983

    申请日:2024-12-09

    Applicant: Waymo LLC

    Abstract: Aspects of the disclosure provide for automatically generating labels for sensor data. For instance, first sensor data for a vehicle may be identified. This first sensor data may have been captured by a first sensor of the vehicle at a first location during a first point in time and may be associated with a first label for an object. Second sensor data for the vehicle may be identified. The second sensor data may have been captured by a second sensor of the vehicle at a second location at a second point in time outside of the first point in time. The second location is different from the first location. A determination may be made as to whether the object is a static object. Based on the determination that the object is a static object, the first label may be used to automatically generate a second label for the second sensor data.

    Contrastive learning for object detection

    公开(公告)号:US11756309B2

    公开(公告)日:2023-09-12

    申请号:US17148148

    申请日:2021-01-13

    Applicant: Waymo LLC

    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a neural network using contrastive learning. One of the methods includes obtaining a network input representing an environment; processing the network input using a first subnetwork of the neural network to generate a respective embedding for each location in the environment; processing the embeddings for each location in the environment using a second subnetwork of the neural network to generate a respective object prediction for each location; determining, for each of a plurality of pairs of the plurality of locations in the environment, whether the respective object predictions of the pair of locations characterize the same possible object or different possible objects; computing a respective contrastive loss value for each of the plurality of pairs of locations; and updating values for a plurality of parameters of the first subnetwork using the computed contrastive loss values.

Patent Agency Ranking