Training a machine-learned model to detect low variance regions

    公开(公告)号:US11605236B2

    公开(公告)日:2023-03-14

    申请号:US16706623

    申请日:2019-12-06

    Applicant: Zoox, Inc.

    Abstract: Low variance detection training is described herein. In an example, annotated data can be determined based on sensor data received from a sensor associated with a vehicle. The annotated data can comprise an annotated low variance region and/or an annotated high variance region. The sensor data can be input into a model, and the model can determine an output comprising a high variance output and a low variance output. In an example, a difference between the annotated data and the output can be determined and one or more parameters associated with the model can be altered based at least in part on the difference. The model can be transmitted to a vehicle configured to be controlled by another output of the model.

    Restricted multi-scale inference for machine learning

    公开(公告)号:US11592818B2

    公开(公告)日:2023-02-28

    申请号:US16013748

    申请日:2018-06-20

    Applicant: Zoox, Inc.

    Abstract: Techniques for utilizing multiple scales of images as input to machine learning (ML) models are discussed herein. Operations can include providing an image associated with a first scale to a first ML model. An output of the first ML model can include a first bounding box indicative of a first region of the image representing a first object, with the first bounding box falling within a first range of sizes. Next, a scaled image can be generated by scaling the image. The scaled image can be provided to a second ML model, which can output a second bounding box indicative of a second region of the image representing a second object, the second bounding falling within a second range of sizes. Thus, inputting a scaled image to a same ML model (or to different ML models) can result in different detected features in the images.

    IMAGE EMBEDDING FOR OBJECT TRACKING

    公开(公告)号:US20210142078A1

    公开(公告)日:2021-05-13

    申请号:US17088447

    申请日:2020-11-03

    Applicant: Zoox, Inc.

    Abstract: Techniques are disclosed for implementing a neural network that outputs embeddings. Furthermore, techniques are disclosed for using sensor data to train a neural network to learn such embeddings. In some examples, the neural network may be trained to learn embeddings. The embeddings may be used for object identification, object matching, object classification, and/or object tracking in various examples.

    SAFETY ANALYSIS FRAMEWORK
    9.
    发明申请

    公开(公告)号:US20210097148A1

    公开(公告)日:2021-04-01

    申请号:US16586838

    申请日:2019-09-27

    Applicant: Zoox, Inc.

    Abstract: Techniques for determining a safety metric associated with a vehicle controller are discussed herein. To determine whether a complex system (which may be uninspectable) is able to operate safely, various operating regimes (scenarios) can be identified based on operating data and associated with a scenario parameter to be adjusted. To validate safe operation of such a system, a scenario may be identified for inspection. Error metrics of a subsystem of the system can be quantified. The error metrics, in addition to stochastic errors of other systems/subsystems can be introduced to the scenario. The scenario parameter may also be perturbed. Any multitude of such perturbations can be instantiated in a simulation to test, for example, a vehicle controller. A safety metric associated with the vehicle controller can be determined based on the simulation, as well as causes for any failures.

    MOTION PREDICTION BASED ON APPEARANCE
    10.
    发明申请

    公开(公告)号:US20200272148A1

    公开(公告)日:2020-08-27

    申请号:US16282201

    申请日:2019-02-21

    Applicant: Zoox, Inc.

    Abstract: Techniques for determining and/or predicting a trajectory of an object by using the appearance of the object, as captured in an image, are discussed herein. Image data, sensor data, and/or a predicted trajectory of the object (e.g., a pedestrian, animal, and the like) may be used to train a machine learning model that can subsequently be provided to, and used by, an autonomous vehicle for operation and navigation. In some implementations, predicted trajectories may be compared to actual trajectories and such comparisons are used as training data for machine learning.

Patent Agency Ranking