公开(公告)号：USD964204S1

公开(公告)日：2022-09-20

申请号：US29797767

申请日：2021-07-02

申请人： Zihao Yang

设计人： Zihao Yang

公开(公告)号：US20240193866A1

公开(公告)日：2024-06-13

申请号：US18078832

申请日：2022-12-09

申请人： Yannick VERDIE ,  Zihao YANG ,  Deepak SRIDHAR ,  Steven George MCDONAGH ,  Juwei LU

发明人： Yannick VERDIE ,  Zihao YANG ,  Deepak SRIDHAR ,  Steven George MCDONAGH ,  Juwei LU

IPC分类号： G06T17/20 ,  G06F3/01 ,  G06V40/20

CPC分类号： G06T17/20 ,  G06F3/017 ,  G06V40/28

摘要： Methods and systems for estimation of a 3D hand pose are disclosed. A 2D image containing a detected hand is processed using a U-net network to obtain a global feature vector and a heatmap for the keypoints of the hand. Information from the global feature vector and the heatmap are concatenated to obtain a set of input tokens that are processed using a transformer encoder to obtain a first set of 2D keypoints representing estimated 2D locations of the keypoints in a first view. The first set of 2D keypoints are inputted as a query to a transformer decoder, to obtain a second set of 2D keypoints representing estimated 2D locations of the keypoints in a second view. The first and second sets of 2D keypoints are aggregated to output the set of estimated 3D keypoints.