MULTI-MODAL 3-D POSE ESTIMATION
    1.
    发明申请

    公开(公告)号:US20220156965A1

    公开(公告)日:2022-05-19

    申请号:US17505900

    申请日:2021-10-20

    Applicant: Waymo LLC

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for estimating a 3-D pose of an object of interest from image and point cloud data. In one aspect, a method includes obtaining an image of an environment; obtaining a point cloud of a three-dimensional region of the environment; generating a fused representation of the image and the point cloud; and processing the fused representation using a pose estimation neural network and in accordance with current values of a plurality of pose estimation network parameters to generate a pose estimation network output that specifies, for each of multiple keypoints, a respective estimated position in the three-dimensional region of the environment.

    Neural networks for coarse- and fine-object classifications

    公开(公告)号:US11361187B1

    公开(公告)日:2022-06-14

    申请号:US17118989

    申请日:2020-12-11

    Applicant: Waymo LLC

    Abstract: Aspects of the subject matter disclosed herein include methods, systems, and other techniques for training, in a first phase, an object classifier neural network with a first set of training data, the first set of training data including a first plurality of training examples, each training example in the first set of training data being labeled with a coarse-object classification; and training, in a second phase after completion of the first phase, the object classifier neural network with a second set of training data, the second set of training data including a second plurality of training examples, each training example in the second set of training data being labeled with a fine-object classification.

    NEURAL NETWORKS FOR COARSE- AND FINE-OBJECT CLASSIFICATIONS

    公开(公告)号:US20220374650A1

    公开(公告)日:2022-11-24

    申请号:US17836287

    申请日:2022-06-09

    Applicant: Waymo LLC

    Abstract: Aspects of the subject matter disclosed herein include methods, systems, and other techniques for training, in a first phase, an object classifier neural network with a first set of training data, the first set of training data including a first plurality of training examples, each training example in the first set of training data being labeled with a coarse-object classification; and training, in a second phase after completion of the first phase, the object classifier neural network with a second set of training data, the second set of training data including a second plurality of training examples, each training example in the second set of training data being labeled with a fine-object classification.

    LEARNING POINT CLOUD AUGMENTATION POLICIES

    公开(公告)号:US20210284184A1

    公开(公告)日:2021-09-16

    申请号:US17194072

    申请日:2021-03-05

    Applicant: Waymo LLC

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining a point cloud augmentation policy and training a machine learning model using the point cloud augmentation policy to perform a perception task such as object detection or classification task by processing point cloud data. In general, training a machine learning model using the determined point cloud augmentation policy enables the model to more effectively perform the perception task, i.e., by generating higher quality perception outputs. When deployed within an on-board system of a vehicle, the machine learning model can further enable the on-board system to generate better-informed planning decisions which in turn result in a safer journey, even when the vehicle is navigating through unconventional environments or inclement weathers such as rain or snow.

    TRAINING DISTILLED MACHINE LEARNING MODELS USING A PRE-TRAINED FEATURE EXTRACTOR

    公开(公告)号:US20220366263A1

    公开(公告)日:2022-11-17

    申请号:US17313655

    申请日:2021-05-06

    Applicant: Waymo LLC

    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training a student machine learning model using a teacher machine learning model that has a pre-trained feature extractor. In one aspect, a method includes obtaining data specifying the teacher machine learning model that is configured to perform a machine learning task; obtaining first training data; training the teacher machine learning model on the first training data to obtain a trained teacher machine learning model; generating second, automatically labeled training data by using the trained teacher machine learning model to process unlabeled training data; and training a student machine learning model to perform the machine learning task using at least the second, automatically labeled training data, wherein the student machine learning model does not include the pre-trained feature extractor and instead includes a different feature extractor having fewer parameters than the pre-trained feature extractor.

Patent Agency Ranking