公开(公告)号：US20220084241A1

公开(公告)日：2022-03-17

申请号：US17372869

申请日：2021-07-12

Applicant: Honda Motor Co., Ltd.

Inventor： Snehal DIKHALE ,  Karankumar PATEL ,  Daksh DHINGRA ,  Soshi IBA ,  Nawid JAMALI

IPC: G06T7/73 ,  G06T7/11 ,  G01S13/86 ,  G01S17/86

Abstract: Systems and methods for visuo-tactile object pose estimation are provided. In one embodiment, a computer implemented method includes receiving image data, depth data, and tactile data about the object in the environment. The computer implemented method also includes generating a visual estimate of the object that includes an object point cloud. The computer implemented method further includes generating a tactile estimate of the object that includes a surface point cloud based on the tactile data. The computer implemented method yet further includes estimating a pose of the object based on the visual estimate and the tactile estimate by fusing the object point cloud and the surface point cloud in a 3D space. The pose is a six-dimensional pose.

公开(公告)号：US20240371022A1

公开(公告)日：2024-11-07

申请号：US18311024

申请日：2023-05-02

Applicant: Honda Motor Co., Ltd.

Inventor： Hongyu LI ,  Nawid JAMALI ,  Snehal DIKHALE ,  Soshi IBA

IPC: G06T7/70 ,  G06T7/50 ,  G06T9/00 ,  G06V10/44 ,  G06V10/74 ,  G06V10/82

Abstract: Systems and methods for visuotactile object pose estimation and shape completion are provided. In one embodiment, a method includes transforming at least one point cloud representation of an object into an input voxel grid of the visualized area of the object. The input voxel grid is a volumetric representation. The method further includes encoding the input voxel grid into a partial latent vector that lies on a partial latent space. The method yet further includes determining a mapping between the partial latent space and a complete latent space based on the sensor data. The method includes predicting a complete latent vector based on the complete latent space. The method also includes estimating a complete shape of an object based on the complete latent space. The method further includes estimating a 6D pose of the object based on the complete latent vector.

公开(公告)号：US20230316734A1

公开(公告)日：2023-10-05

申请号：US17710922

申请日：2022-03-31

Applicant: Honda Motor Co., Ltd.

Inventor： Daksh DHINGRA ,  Nawid JAMALI ,  Snehal DIKHALE ,  Karankumar PATEL ,  Soshi IBA

IPC: G06V10/80 ,  G06T7/10 ,  G06V10/82 ,  G06V20/56

CPC classification number: G06V10/803 ,  G06T7/10 ,  G06V10/82 ,  G06V20/56 ,  G06T2207/20084 ,  G06T2207/30252 ,  G06T2207/20072

Abstract: Pose fusion estimation may be achieved via a first and second set of sensors receiving a first and second set of data, passing the first and second set of data through a graph-based neural network to generate a set of geometric features to be passed through a pose fusion network to generate a first and second pose estimate. A second portion of the pose fusion network may receive the set of geometric features and generate a second set of geometric features and the second pose estimate based on the set of geometric features. A first portion of the pose fusion network may receive the first set of data and the second set of geometric features and generate the first pose estimate based on a fusion of the first set of data and the second set of geometric features.