CROSS-ATTENTION PERCEPTION MODEL TRAINED TO USE SENSOR AND/OR MAP DATA

    公开(公告)号:US20240353231A1

    公开(公告)日:2024-10-24

    申请号:US18304975

    申请日:2023-04-21

    申请人: Zoox, Inc.

    IPC分类号: G01C21/32 G06N20/20

    CPC分类号: G01C21/32 G06N20/20

    摘要: A transformer-based machine-learned model may use cross-attention between map data and various sensor data and/or perception data, such as an object detection, to augment perception tasks. In particular, the transformer-based machine-learned model may comprise two or more encoders, one of which may determine a first embedding from map data and a second encoder that may determine a second embedding from sensor data and/or perception data. An encoder may determine a score that may be used to determine various outputs that may improve partially occluded object detection, ground plane classification, static object detection, and suppress false positive object detections.

    Drift detection
    3.
    发明授权

    公开(公告)号:US12117529B1

    公开(公告)日:2024-10-15

    申请号:US17846874

    申请日:2022-06-22

    申请人: Zoox, Inc.

    摘要: Techniques for determining errors or drifts between maps used for updating maps and/or controlling a system which uses the map. In some examples, a first, global, map may be received or determined. Sensor data may then be used to localize a system with respect to the first map and to generate a first trajectory relative to the first map. The sensor data may be used to create a second map and a second trajectory for navigating the system relative to the second map. Differences between the first and second trajectories (or portions thereof), when compared in a common reference frame, may be used as an indication of drift between various processes or errors in the maps and, subsequently, be used for updating the first map and/or controlling the system.