Automatic labeling of objects in sensor data

    公开(公告)号:US12204969B2

    公开(公告)日:2025-01-21

    申请号:US17893376

    申请日:2022-08-23

    Applicant: WAYMO LLC

    Abstract: Aspects of the disclosure provide for automatically generating labels for sensor data. For instance, first sensor data, for a vehicle may be identified. This first sensor data may have been captured by a first sensor of the vehicle at a first location during a first point in time and may be associated with a first label for an object. Second sensor data for the vehicle may be identified. The second sensor data may have been captured by a second sensor of the vehicle at a second location at a second point in time outside of the first point in time. The second location is different from the first location. A determination may be made as to whether the object is a static object. Based on the determination that the object is a static object, the first label may be used to automatically generate a second label for the second sensor data.

    AUTOMATIC LABELING OF OBJECTS IN SENSOR DATA

    公开(公告)号:US20210303956A1

    公开(公告)日:2021-09-30

    申请号:US16827835

    申请日:2020-03-24

    Applicant: WAYMO LLC

    Abstract: Aspects of the disclosure provide for automatically generating labels for sensor data. For instance, first sensor data for a first vehicle may be identified. This first sensor data may have been captured by a first sensor of the vehicle at a first location during a first point in time and may be associated with a first label for an object. Second sensor data for a vehicle may be identified. The second sensor data may have been captured by a second sensor of the vehicle at a second location at a second point in time outside of the first point in time. The second location is different from the first location. The object is a static object may be determined. Based on the determination that the object is a static object, the first label may be used to automatically generate a second label for the second sensor data.

    Detecting Unfamiliar Signs
    3.
    发明申请

    公开(公告)号:US20210191419A1

    公开(公告)日:2021-06-24

    申请号:US17150228

    申请日:2021-01-15

    Applicant: Waymo LLC

    Abstract: Aspects of the disclosure relate to determining a sign type of an unfamiliar sign. The system may include one or more processors. The one or more processors may be configured to receive an image and identify image data corresponding to a traffic sign in the image. The image data corresponding to the traffic sign may be input in a sign type model. The processors may determine that the sign type model was unable to identify a type of the traffic sign and determine one or more attributes of the traffic sign. The one or more attributes of the traffic sign may be compared to known attributes of other traffic signs and based on this comparison, a sign type of the traffic sign may be determined. The vehicle may be controlled in an autonomous driving mode based on the sign type of the traffic sign.

    Interacted object detection neural network

    公开(公告)号:US11043003B2

    公开(公告)日:2021-06-22

    申请号:US16686840

    申请日:2019-11-18

    Applicant: Waymo LLC

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating object interaction predictions using a neural network. One of the methods includes obtaining a sensor input derived from data generated by one or more sensors that characterizes a scene. The sensor input is provided to an object interaction neural network. The object interaction neural network is configured to process the sensor input to generate a plurality of object interaction outputs. Each respective object interaction output includes main object information and interacting object information. The respective object interaction outputs corresponding to the plurality of regions in the sensor input are received as output of the object interaction neural network.

    Detecting unfamiliar signs
    5.
    发明授权

    公开(公告)号:US11836955B2

    公开(公告)日:2023-12-05

    申请号:US17150228

    申请日:2021-01-15

    Applicant: Waymo LLC

    Abstract: Aspects of the disclosure relate to determining a sign type of an unfamiliar sign. The system may include one or more processors. The one or more processors may be configured to receive an image and identify image data corresponding to a traffic sign in the image. The image data corresponding to the traffic sign may be input in a sign type model. The processors may determine that the sign type model was unable to identify a type of the traffic sign and determine one or more attributes of the traffic sign. The one or more attributes of the traffic sign may be compared to known attributes of other traffic signs and based on this comparison, a sign type of the traffic sign may be determined. The vehicle may be controlled in an autonomous driving mode based on the sign type of the traffic sign.

    Phrase recognition model for autonomous vehicles

    公开(公告)号:US11562573B2

    公开(公告)日:2023-01-24

    申请号:US17123185

    申请日:2020-12-16

    Applicant: WAYMO LLC

    Abstract: Aspects of the disclosure relate to training and using a phrase recognition model to identify phrases in images. As an example, a selected phrase list may include a plurality of phrases is received. Each phrase of the plurality of phrases includes text. An initial plurality of images may be received. A training image set may be selected from the initial plurality of images by identifying the phrase-containing images that include one or more phrases from the selected phrase list. Each given phrase-containing image of the training image set may be labeled with information identifying the one or more phrases from the selected phrase list included in the given phrase-containing images. The model may be trained based on the training image set such that the model is configured to, in response to receiving an input image, output data indicating whether a phrase of the plurality of phrases is included in the input image.

    Phrase recognition model for autonomous vehicles

    公开(公告)号:US10699141B2

    公开(公告)日:2020-06-30

    申请号:US16018490

    申请日:2018-06-26

    Applicant: Waymo LLC

    Abstract: Aspects of the disclosure relate to training and using a phrase recognition model to identify phrases in images. As an example, a selected phrase list may include a plurality of phrases is received. Each phrase of the plurality of phrases includes text. An initial plurality of images may be received. A training image set may be selected from the initial plurality of images by identifying the phrase-containing images that include one or more phrases from the selected phrase list. Each given phrase-containing image of the training image set may be labeled with information identifying the one or more phrases from the selected phrase list included in the given phrase-containing images. The model may be trained based on the training image set such that the model is configured to, in response to receiving an input image, output data indicating whether a phrase of the plurality of phrases is included in the input image.

    AUTOMATIC LABELING OF OBJECTS IN SENSOR DATA

    公开(公告)号:US20250103844A1

    公开(公告)日:2025-03-27

    申请号:US18973983

    申请日:2024-12-09

    Applicant: Waymo LLC

    Abstract: Aspects of the disclosure provide for automatically generating labels for sensor data. For instance, first sensor data for a vehicle may be identified. This first sensor data may have been captured by a first sensor of the vehicle at a first location during a first point in time and may be associated with a first label for an object. Second sensor data for the vehicle may be identified. The second sensor data may have been captured by a second sensor of the vehicle at a second location at a second point in time outside of the first point in time. The second location is different from the first location. A determination may be made as to whether the object is a static object. Based on the determination that the object is a static object, the first label may be used to automatically generate a second label for the second sensor data.

    Camera assessment techniques for autonomous vehicles

    公开(公告)号:US11227409B1

    公开(公告)日:2022-01-18

    申请号:US16105084

    申请日:2018-08-20

    Applicant: Waymo LLC

    Abstract: The disclosure relates to assessing operation of a camera. In one instance, a volume of space corresponding to a first vehicle in an environment of a second vehicle may be identified using sensor data generated by a LIDAR system of the second vehicle. An image captured by a camera of the second vehicle may be identified. The camera may have an overlapping field of view of the LIDAR system at a time when the sensor data was generated. An area of the image corresponding to the volume of space may be identified and processed in order to identify a vehicle light. The operation of the camera may be assessed based on the processing.

    Interacted Object Detection Neural Network

    公开(公告)号:US20210295555A1

    公开(公告)日:2021-09-23

    申请号:US17342434

    申请日:2021-06-08

    Applicant: Waymo LLC

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating object interaction predictions using a neural network. One of the methods includes obtaining a sensor input derived from data generated by one or more sensors that characterizes a scene. The sensor input is provided to an object interaction neural network. The object interaction neural network is configured to process the sensor input to generate a plurality of object interaction outputs. Each respective object interaction output includes main object information and interacting object information. The respective object interaction outputs corresponding to the plurality of regions in the sensor input are received as output of the object interaction neural network.

Patent Agency Ranking