SYSTEMS AND METHODS FOR VISUOTACTILE OBJECT POSE ESTIMATION WITH SHAPE COMPLETION

    公开(公告)号:US20240371022A1

    公开(公告)日:2024-11-07

    申请号:US18311024

    申请日:2023-05-02

    Abstract: Systems and methods for visuotactile object pose estimation and shape completion are provided. In one embodiment, a method includes transforming at least one point cloud representation of an object into an input voxel grid of the visualized area of the object. The input voxel grid is a volumetric representation. The method further includes encoding the input voxel grid into a partial latent vector that lies on a partial latent space. The method yet further includes determining a mapping between the partial latent space and a complete latent space based on the sensor data. The method includes predicting a complete latent vector based on the complete latent space. The method also includes estimating a complete shape of an object based on the complete latent space. The method further includes estimating a 6D pose of the object based on the complete latent vector.

    SYSTEMS AND METHODS FOR TAXEL HYPER-RESOLUTION THROUGH MULTI-CONTACT LOCALIZATION

    公开(公告)号:US20250162169A1

    公开(公告)日:2025-05-22

    申请号:US18517649

    申请日:2023-11-22

    Abstract: Systems and methods for taxel hyper-resolution output are provided. Tactile sensors contact an object and produce taxel data for each contact made. Taxel data from the tactile sensors is encoded and compared with detailed geometric data of a known object to generate a set of ranked poses. For each pose one or more substantially matching candidate poses from the stored geometric data are generated. Pairs of poses are iteratively compared with pairs of candidate poses to determine the most probable candidate pose for each pose. Taxel hyper-resolution data for determined poses is generated from the detailed geometric data and output for use by downstream systems.

    TAXEL-BASED TACTILE SENSOR
    3.
    发明申请

    公开(公告)号:US20250137859A1

    公开(公告)日:2025-05-01

    申请号:US18385541

    申请日:2023-10-31

    Abstract: A method for a taxel-based tactile sensor system includes receiving a set of taxel data having a subset of tactile data for an object and a subset of contact surface data for the object. The method also includes encoding the tactile data into a tactile embedding with a tactile encoder, and encoding the contact surface data into a surface embedding with a surface encoder. The method also includes computing a matrix of proximity values based on the tactile data encoded in the tactile embedding and contact surface data encoded in the surface embedding, and generating a tactile representation for the taxel data based on the proximity values.

Patent Agency Ranking