公开(公告)号：US20180350105A1

公开(公告)日：2018-12-06

申请号：US15994563

申请日：2018-05-31

Applicant: Google LLC

Inventor： Jonathan James TAYLOR ,  Vladimir TANKOVICH ,  Danhang TANG ,  Cem KESKIN ,  Adarsh Prakash Murthy KOWDLE ,  Philip L. DAVIDSON ,  Shahram IZADI ,  David KIM

IPC: G06T7/73 ,  G06K9/00

CPC classification number: G06T7/75 ,  G06K9/00382 ,  G06T7/149 ,  G06T7/162 ,  G06T7/194 ,  G06T7/251 ,  G06T2207/10016 ,  G06T2207/10028 ,  G06T2207/20076 ,  G06T2207/20081

Abstract: An electronic device estimates a pose of a hand by volumetrically deforming a signed distance field using a skinned tetrahedral mesh to locate a local minimum of an energy function, wherein the local minimum corresponds to the hand pose. The electronic device identifies a pose of the hand by fitting an implicit surface model of a hand to the pixels of a depth image that correspond to the hand. The electronic device uses a skinned tetrahedral mesh to warp space from a base pose to a deformed pose to define an articulated signed distance field from which the hand tracking module derives candidate poses of the hand. The electronic device then minimizes an energy function based on the distance of each corresponding pixel to identify the candidate pose that most closely approximates the pose of the hand.

公开(公告)号：US20180356883A1

公开(公告)日：2018-12-13

申请号：US16002595

申请日：2018-06-07

Applicant: Google LLC

Inventor： Julien Pascal Christophe VALENTIN ,  Jonathan James TAYLOR ,  Shahram IZADI

IPC: G06F3/01 ,  G06T7/70

Abstract: An electronic device estimates a pose of a face by fitting a generative face model mesh to a depth map based on vertices of the face model mesh that are estimated to be visible from the point of view of a depth camera. A face tracking module of the electronic device receives a depth image of a face from a depth camera and generates a depth map of the face based on the depth image. The face tracking module identifies a pose of the face by fitting a face model mesh to the pixels of a depth map that correspond to the vertices of the face model mesh that are estimated to be visible from the point of view of the depth camera.