TRAJECTORY PREDICTION ON TOP-DOWN SCENES AND ASSOCIATED MODEL

    公开(公告)号:US20220092983A1

    公开(公告)日:2022-03-24

    申请号:US17542880

    申请日:2021-12-06

    Applicant: Zoox, Inc.

    Abstract: Techniques are discussed for determining prediction probabilities of an object based on a top-down representation of an environment. Data representing objects in an environment can be captured. Aspects of the environment can be represented as map data. A multi-channel image representing a top-down view of object(s) in the environment can be generated based on the data representing the objects and map data. The multi-channel image can be used to train a machine learned model by minimizing an error between predictions from the machine learned model and a captured trajectory associated with the object. Once trained, the machine learned model can be used to generate prediction probabilities of objects in an environment, and the vehicle can be controlled based on such prediction probabilities.

    PREDICTION ON TOP-DOWN SCENES BASED ON ACTION DATA

    公开(公告)号:US20210271901A1

    公开(公告)日:2021-09-02

    申请号:US17325562

    申请日:2021-05-20

    Applicant: Zoox, Inc.

    Abstract: Techniques for determining predictions on a top-down representation of an environment based on vehicle action(s) are discussed herein. Sensors of a first vehicle (such as an autonomous vehicle) can capture sensor data of an environment, which may include object(s) separate from the first vehicle (e.g., a vehicle or a pedestrian). A multi-channel image representing a top-down view of the object(s) and the environment can be generated based on the sensor data, map data, and/or action data. Environmental data (object extents, velocities, lane positions, crosswalks, etc.) can be encoded in the image. Action data can represent a target lane, trajectory, etc. of the first vehicle. Multiple images can be generated representing the environment over time and input into a prediction system configured to output prediction probabilities associated with possible locations of the object(s) in the future, which may be based on the actions of the autonomous vehicle.

    YIELD BEHAVIOR MODELING AND PREDICTION

    公开(公告)号:US20210053570A1

    公开(公告)日:2021-02-25

    申请号:US16549704

    申请日:2019-08-23

    Applicant: Zoox, Inc.

    Abstract: Techniques for determining a vehicle action and controlling a vehicle to perform the vehicle action for navigating the vehicle in an environment can include determining a vehicle action, such as a lane change action, for a vehicle to perform in an environment. The vehicle can detect, based at least in part on sensor data, an object associated with a target lane associated with the lane change action sensor data. In some instances, the vehicle may determine attribute data associated with the object and input the attribute data to a machine-learned model that can output a yield score. Based on such a yield score, the vehicle may determine whether it is safe to perform the lane change action.

    Trajectory prediction on top-down scenes and associated model

    公开(公告)号:US12183204B2

    公开(公告)日:2024-12-31

    申请号:US17542880

    申请日:2021-12-06

    Applicant: Zoox, Inc.

    Abstract: Techniques are discussed for determining prediction probabilities of an object based on a top-down representation of an environment. Data representing objects in an environment can be captured. Aspects of the environment can be represented as map data. A multi-channel image representing a top-down view of object(s) in the environment can be generated based on the data representing the objects and map data. The multi-channel image can be used to train a machine learned model by minimizing an error between predictions from the machine learned model and a captured trajectory associated with the object. Once trained, the machine learned model can be used to generate prediction probabilities of objects in an environment, and the vehicle can be controlled based on such prediction probabilities.

    Map consistency checker
    37.
    发明授权

    公开(公告)号:US11472442B2

    公开(公告)日:2022-10-18

    申请号:US16856826

    申请日:2020-04-23

    Applicant: Zoox, Inc.

    Abstract: Techniques relating to monitoring map consistency are described. In an example, a monitoring component associated with a vehicle can receive sensor data associated with an environment in which the vehicle is positioned. The monitoring component can generate, based at least in part on the sensor data, an estimated map of the environment, wherein the estimated map is encoded with policy information for driving within the environment. The monitoring component can then compare first information associated with a stored map of the environment with second information associated with the estimated map to determine whether the estimated map and the stored map are consistent. Component(s) associated with the vehicle can then control the object based at least in part on results of the comparing.

    Object trajectory from wheel direction

    公开(公告)号:US11460850B1

    公开(公告)日:2022-10-04

    申请号:US16412127

    申请日:2019-05-14

    Applicant: Zoox, Inc.

    Abstract: A trajectory estimate of a wheeled vehicle can be determined based at least in part on determining a wheel angle associated with the vehicle. In some examples, at least a portion of the image associated with the wheeled vehicle may be input into a machine-learned model that is trained to classify and/or regress wheel directions of wheeled vehicles. The machine-learned model may output a predicted wheel direction. The wheel direction and/or additional or historical sensor data may be used to estimate a trajectory of the wheeled vehicle. The predicted trajectory of the object can then be used to generate and refine an autonomous vehicle's trajectory as the autonomous vehicle proceeds through the environment.

    Supplementing top-down predictions with image features

    公开(公告)号:US11380108B1

    公开(公告)日:2022-07-05

    申请号:US16586646

    申请日:2019-09-27

    Applicant: Zoox, Inc.

    Abstract: The described techniques relate to predicting object behavior based on top-down representations of an environment comprising top-down representations of image features in the environment. For example, a top-down representation may comprise a multi-channel image that includes semantic map information along with additional information for a target object and/or other objects in an environment. A top-down image feature representation may also be a multi-channel image that incorporates various tensors for different image features with channels of the multi-channel image, and may be generated directly from an input image. A prediction component can generate predictions of object behavior based at least in part on the top-down image feature representation, and in some cases, can generate predictions based on the top-down image feature representation together with the additional top-down representation.

    Updating map data
    40.
    发明授权

    公开(公告)号:US11280630B2

    公开(公告)日:2022-03-22

    申请号:US16698366

    申请日:2019-11-27

    Applicant: Zoox, Inc.

    Abstract: Techniques are disclosed for updating map data. The techniques may include detecting a traffic light in a first image, determining, based at least in part on the traffic light detected in the first image, a proposed three-dimensional position of the traffic light in a three-dimensional coordinate system associated with map data. The proposed three-dimensional position may then be projected into a second image to determine a two-dimensional position of the traffic light in the second image and the second image may be annotated, as an annotated image, with a proposed traffic light location indicator associated with the traffic light. The techniques further include causing a display to display the annotated image to a user, receiving user input associated with the annotated images, and updating, as updated map data, the map data to include a position of the traffic light in the map data based at least in part on the user input.

Patent Agency Ranking