Object-centric three-dimensional auto labeling of point cloud data

    公开(公告)号:US12073575B2

    公开(公告)日:2024-08-27

    申请号:US17407795

    申请日:2021-08-20

    Applicant: Waymo LLC

    CPC classification number: G06T7/521 G06T7/20 G06T2207/10028 G06T2207/20084

    Abstract: Methods, computer systems, and apparatus, including computer programs encoded on computer storage media, for performing three-dimensional auto-labeling on sensor data. The system obtains a sensor data segment that includes a temporal sequence of three-dimensional point clouds generated from sensor readings of an environment by one or more sensors. The system identifies, from the sensor data segment, (i) a plurality of object tracks that each corresponds to a different object in the environment and (ii) for each object track, respective initial three-dimensional regions in each of one or more of the point clouds in which the corresponding object appears. The system generates, for each object track, extracted object track data that includes at least the points in the respective initial three-dimensional regions for the object track. The system further generates, for each object track and from the extracted object track data for the object track, an auto labeling output that defines respective refined three-dimensional regions in each of the one or more point clouds.

    Generating realistic point clouds

    公开(公告)号:US11295517B2

    公开(公告)日:2022-04-05

    申请号:US17099589

    申请日:2020-11-16

    Applicant: Waymo LLC

    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating realistic full-scene point clouds. One of the methods includes obtaining an initial scene point cloud characterizing an initial scene in an environment; obtaining, for each of one or more objects, an object point cloud that characterizes the object; and processing a first input comprising the initial scene point cloud and the one or more object point clouds using a first neural network that is configured to process the first input to generate a final scene point cloud that characterizes a transformed scene that has the one or more objects added to the initial scene.

    Generating realistic point clouds

    公开(公告)号:US11922569B2

    公开(公告)日:2024-03-05

    申请号:US17713108

    申请日:2022-04-04

    Applicant: Waymo LLC

    CPC classification number: G06T17/00 G06N3/045 G06N20/00 G06V20/10

    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating realistic full-scene point clouds. One of the methods includes obtaining an initial scene point cloud characterizing an initial scene in an environment; obtaining, for each of one or more objects, an object point cloud that characterizes the object; and processing a first input comprising the initial scene point cloud and the one or more object point clouds using a first neural network that is configured to process the first input to generate a final scene point cloud that characterizes a transformed scene that has the one or more objects added to the initial scene.

    HIGH THROUGHPUT POINT CLOUD PROCESSING
    8.
    发明公开

    公开(公告)号:US20240062386A1

    公开(公告)日:2024-02-22

    申请号:US18235292

    申请日:2023-08-17

    Applicant: Waymo LLC

    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing sensor data, e.g., laser sensor data, using neural networks. One of the methods includes obtaining a temporal sequence of multiple three-dimensional point clouds generated from sensor readings of an environment collected by one or more sensors within a given time period, each three-dimensional point cloud comprising a respective plurality of points in a first coordinate system; processing, using a feature extraction neural network, an input that comprises data derived from the temporal sequence of multiple three-dimensional point clouds to generate a feature embedding; receiving a query that specifies one time point within the given time period; and generating, from the feature embedding and conditioned on the query, one or more outputs that characterize one or more objects in the environment at the time point specified in the received query.

    Generating Environmental Data
    9.
    发明申请

    公开(公告)号:US20210150799A1

    公开(公告)日:2021-05-20

    申请号:US17098943

    申请日:2020-11-16

    Applicant: Waymo LLC

    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generated simulated sensor data. One of the methods includes obtaining a surfel map generated from sensor observations of a real-world environment and generating, for each surfel in the surfel map, a respective grid having a plurality of grid cells, wherein each grid has an orientation matching an orientation of a corresponding surfel, and wherein each grid cell within each grid is assigned a respective color value. For a simulated location within a simulated representation of the real-world environment, a textured surfel rendering is generated, including combining color information from grid cells visible from the simulated location within the simulated representation of the real-world environment.

Patent Agency Ranking