公开(公告)号：US20230316734A1

公开(公告)日：2023-10-05

申请号：US17710922

申请日：2022-03-31

Applicant: Honda Motor Co., Ltd.

Inventor： Daksh DHINGRA ,  Nawid JAMALI ,  Snehal DIKHALE ,  Karankumar PATEL ,  Soshi IBA

IPC: G06V10/80 ,  G06T7/10 ,  G06V10/82 ,  G06V20/56

CPC classification number: G06V10/803 ,  G06T7/10 ,  G06V10/82 ,  G06V20/56 ,  G06T2207/20084 ,  G06T2207/30252 ,  G06T2207/20072

Abstract: Pose fusion estimation may be achieved via a first and second set of sensors receiving a first and second set of data, passing the first and second set of data through a graph-based neural network to generate a set of geometric features to be passed through a pose fusion network to generate a first and second pose estimate. A second portion of the pose fusion network may receive the set of geometric features and generate a second set of geometric features and the second pose estimate based on the set of geometric features. A first portion of the pose fusion network may receive the first set of data and the second set of geometric features and generate the first pose estimate based on a fusion of the first set of data and the second set of geometric features.

公开(公告)号：US20220084241A1

公开(公告)日：2022-03-17

申请号：US17372869

申请日：2021-07-12

Applicant: Honda Motor Co., Ltd.

Inventor： Snehal DIKHALE ,  Karankumar PATEL ,  Daksh DHINGRA ,  Soshi IBA ,  Nawid JAMALI

IPC: G06T7/73 ,  G06T7/11 ,  G01S13/86 ,  G01S17/86

Abstract: Systems and methods for visuo-tactile object pose estimation are provided. In one embodiment, a computer implemented method includes receiving image data, depth data, and tactile data about the object in the environment. The computer implemented method also includes generating a visual estimate of the object that includes an object point cloud. The computer implemented method further includes generating a tactile estimate of the object that includes a surface point cloud based on the tactile data. The computer implemented method yet further includes estimating a pose of the object based on the visual estimate and the tactile estimate by fusing the object point cloud and the surface point cloud in a 3D space. The pose is a six-dimensional pose.