ASSOCIATING LIDAR DATA AND IMAGE DATA
    2.
    发明申请

    公开(公告)号:US20190340775A1

    公开(公告)日:2019-11-07

    申请号:US15970838

    申请日:2018-05-03

    申请人: Zoox, Inc.

    摘要: A monocular image often does not contain enough information to determine, with certainty, the depth of an object in a scene reflected in the image. Combining image data and LIDAR data may enable determining a depth estimate of the object relative to the camera. Specifically, LIDAR points corresponding to a region of interest (“ROI”) in the image that corresponds to the object may be combined with the image data. These LIDAR points may be scored according to a monocular image model and/or a factor based on a distance between projections of the LIDAR points into the ROI and a center of the region of interest may improve the accuracy of the depth estimate. Using these scores as weights in a weighted median of the LIDAR points may improve the accuracy of the depth estimate, for example, by discerning between a detected object and an occluding object and/or background.

    ASSOCIATING LIDAR DATA AND IMAGE DATA

    公开(公告)号:US20210104056A1

    公开(公告)日:2021-04-08

    申请号:US16940216

    申请日:2020-07-27

    申请人: Zoox, Inc.

    摘要: A monocular image often does not contain enough information to determine, with certainty, the depth of an object in a scene reflected in the image. Combining image data and LIDAR data may enable determining a depth estimate of the object relative to the camera. Specifically, LIDAR points corresponding to a region of interest (“ROI”) in the image that corresponds to the object may be combined with the image data. These LIDAR points may be scored according to a monocular image model and/or a factor based on a distance between projections of the LIDAR points into the ROI and a center of the region of interest may improve the accuracy of the depth estimate. Using these scores as weights in a weighted median of the LIDAR points may improve the accuracy of the depth estimate, for example, by discerning between a detected object and an occluding object and/or background.

    Object velocity detection from multi-modal sensor data

    公开(公告)号:US11628855B1

    公开(公告)日:2023-04-18

    申请号:US16866839

    申请日:2020-05-05

    申请人: Zoox, Inc.

    摘要: Ground truth data may be too sparse to supervise training of a machine-learned (ML) model enough to achieve an ML model with sufficient accuracy/recall. For example, in some cases, ground truth data may only be available for every third, tenth, or hundredth frame of raw data. Training an ML model to detect a velocity of an object when ground truth data for training is sparse may comprise training the ML model to predict a future position of the object based at least in part on image, radar, and/or lidar data (e.g., for which no ground truth may be available). The ML model may be altered based at least in part on a difference between ground truth data associated with a future time and the future position.

    Associating LIDAR data and image data

    公开(公告)号:US10726567B2

    公开(公告)日:2020-07-28

    申请号:US15970838

    申请日:2018-05-03

    申请人: Zoox, Inc.

    摘要: A monocular image often does not contain enough information to determine, with certainty, the depth of an object in a scene reflected in the image. Combining image data and LIDAR data may enable determining a depth estimate of the object relative to the camera. Specifically, LIDAR points corresponding to a region of interest (“ROI”) in the image that corresponds to the object may be combined with the image data. These LIDAR points may be scored according to a monocular image model and/or a factor based on a distance between projections of the LIDAR points into the ROI and a center of the region of interest may improve the accuracy of the depth estimate. Using these scores as weights in a weighted median of the LIDAR points may improve the accuracy of the depth estimate, for example, by discerning between a detected object and an occluding object and/or background.

    OUT OF SEQUENCE PRECEPTION SYSTEM
    8.
    发明公开

    公开(公告)号:US20240241257A1

    公开(公告)日:2024-07-18

    申请号:US18417356

    申请日:2024-01-19

    申请人: Zoox, Inc.

    摘要: Techniques for updating data operations in a perception system are discussed herein. A vehicle may use a perception system to capture data about an environment proximate to the vehicle. The perception system may receive image data, lidar data, and/or radar data to determine information about an object in the environment. As different sensors may be associated with different time periods for capturing and/or processing operations, the techniques include updating object data with data from sensors associated with a shorter time period to generate intermediate object data. Such intermediate object data may reduce a delay in updating a position of an object in an environment, which may improve reaction time(s) and/or safety outcomes in systems implementing such perception systems, such as an autonomous vehicle.