-
公开(公告)号:US20230294276A1
公开(公告)日:2023-09-21
申请号:US18148548
申请日:2022-12-30
Applicant: Nvidia Corporation
Inventor: Yu-Wei Chao , Yu Xiang , Wei Yang , Dieter Fox , Chris Paxton , Balakumar Sundaralingam , Maya Cakmak
IPC: B25J9/16
CPC classification number: B25J9/1605 , B25J9/163 , G05B2219/39001
Abstract: Approaches presented herein provide for simulation of human motion for human-robot interactions, such as may involve a handover of an object. Motion capture can be performed for a hand grasping and moving an object to a location and orientation appropriate for a handover, without a need for a robot to be present or an actual handover to occur. This motion data can be used to separately model the hand and the object for use in a handover simulation, where a component such as a physics engine may be used to ensure realistic modeling of the motion or behavior. During a simulation, a robot control model or algorithm can predict an optimal location and orientation to grasp an object, and an optimal path to move to that location and orientation, using a control model or algorithm trained, based at least in part, using the motion models for the hand and object.
-
公开(公告)号:US20220292699A1
公开(公告)日:2022-09-15
申请号:US17195296
申请日:2021-03-08
Applicant: NVIDIA Corporation
Inventor: Luyang Zhu , Arsalan Mousavian , Yu Xiang , Dieter Fox
Abstract: Apparatuses, systems, and techniques to estimate or predict depth information for image data. In at least one embodiment, depth information is predicted based at least in part on color information and geometry information associated with an image.
-
公开(公告)号:US11798183B2
公开(公告)日:2023-10-24
申请号:US17195296
申请日:2021-03-08
Applicant: NVIDIA Corporation
Inventor: Luyang Zhu , Arsalan Mousavian , Yu Xiang , Dieter Fox
CPC classification number: G06T7/521 , G05D1/0214 , G05D1/0221 , G05D1/0251 , G06N3/045 , G06N20/00 , G06T7/55 , G06T7/90 , G06T15/06 , G05D2201/0213 , G06T2207/10028
Abstract: Apparatuses, systems, and techniques to estimate or predict depth information for image data. In at least one embodiment, depth information is predicted based at least in part on color information and geometry information associated with an image.
-
公开(公告)号:US11670001B2
公开(公告)日:2023-06-06
申请号:US16416075
申请日:2019-05-17
Applicant: NVIDIA Corporation
Inventor: Arsalan Mousavian , Yu Xiang , Dieter Fox
CPC classification number: G06V20/58 , G06N3/0454 , G06N3/08 , G06T7/75 , G06T11/20 , G06T2207/20084 , G06T2210/12
Abstract: In an embodiment, a system provides object tracking and 6D pose estimations to a robot that performs different tasks such as manipulation and navigation. In an embodiment the 6D object pose is determined using a Rao-Blackwellized particle filtering framework, where the 3-D rotation and the 3-D translation of the object is decoupled. In an embodiment, the system provides the 3-D translation of an object along with a full distribution over the 3-D rotation. In an embodiment, the 3-D rotation is determined by discretizing the rotation space, and training an autoencoder network to construct a codebook of feature embeddings for the discretized rotations. In an embodiment, the system is able to track objects with arbitrary symmetries while also maintaining adequate posterior distributions.
-
公开(公告)号:US20210158561A1
公开(公告)日:2021-05-27
申请号:US16922629
申请日:2020-07-07
Applicant: NVIDIA Corporation
Inventor: Keunhong Park , Arsalan Mousavian , Yu Xiang , Dieter Fox
Abstract: Apparatuses, systems, and techniques estimate a pose of an object based on images generated from a combined image volume. In at least one embodiment, the combined image volume is obtained from a plurality of image volumes generated based on a plurality of images of an object.
-
-
-
-