公开(公告)号：US20160086349A1

公开(公告)日：2016-03-24

申请号：US14494467

申请日：2014-09-23

Applicant: Microsoft Corporation

Inventor： Jamie Daniel Joseph Shotton ,  Duncan Paul Robertson ,  Jonathan James Taylor ,  Cem Keskin ,  Shahram Izadi ,  Andrew William Fitzgibbon

IPC: G06T7/20 ,  G06T7/00 ,  G06T13/40 ,  G06T19/00 ,  G06T19/20 ,  G06F3/01 ,  G06T17/00

CPC classification number: G06T19/20 ,  G06F3/017 ,  G06T7/75 ,  G06T2207/10016 ,  G06T2207/30196

Abstract: Tracking hand pose from image data is described, for example, to control a natural user interface or for augmented reality. In various examples an image is received from a capture device, the image depicting at least one hand in an environment. For example, a hand tracker accesses a 3D model of a hand and forearm and computes pose of the hand depicted in the image by comparing the 3D model with the received image.

Abstract translation: 描述了从图像数据跟踪手姿势，例如，以控制自然界面或增强现实。 在各种示例中，从捕获装置接收图像，该图像描绘环境中的至少一只手。 例如，手动跟踪器访问手和前臂的3D模型，并通过将3D模型与接收到的图像进行比较来计算图像中描绘的手的姿态。

公开(公告)号：US20160085310A1

公开(公告)日：2016-03-24

申请号：US14494431

申请日：2014-09-23

Applicant: Microsoft Corporation

Inventor： Jamie Daniel Joseph Shotton ,  Cem Keskin ,  Jonathan James Taylor ,  Toby Sharp ,  Shahram Izadi ,  Andrew William Fitzgibbon ,  Pushmeet Kohli ,  Duncan Paul Robertson

IPC: G06F3/01 ,  G06K9/00

CPC classification number: G06K9/00335 ,  G06F3/011 ,  G06F3/017 ,  G06F3/0304 ,  G06K9/00342 ,  G06K9/00355 ,  G06K9/52 ,  G06K9/6219 ,  G06K9/6263 ,  G06K9/6267 ,  G06K9/6282 ,  G06K9/66

Abstract: Tracking hand or body pose from image data is described, for example, to control a game system, natural user interface or for augmented reality. In various examples a prediction engine takes a single frame of image data and predicts a distribution over a pose of a hand or body depicted in the image data. In examples, a stochastic optimizer has a pool of candidate poses of the hand or body which it iteratively refines, and samples from the predicted distribution are used to replace some candidate poses in the pool. In some examples a best candidate pose from the pool is selected as the current tracked pose and the selection processes uses a 3D model of the hand or body.

Abstract translation: 描述从图像数据跟踪手或身体姿势，例如，控制游戏系统，自然用户界面或增强现实。 在各种示例中，预测引擎采用单帧图像数据并且预测在图像数据中描绘的手或身体的姿势上的分布。 在示例中，随机优化器具有反复精炼的手或身体的候选姿势池，并且来自预测分布的样本用于替换池中的一些候选姿势。 在一些示例中，来自池的最佳候选姿势被选择为当前跟踪姿势，并且选择过程使用手或身体的3D模型。