公开(公告)号：US09811721B2

公开(公告)日：2017-11-07

申请号：US14706649

申请日：2015-05-07

Applicant: Apple Inc.

Inventor： Feng Tang ,  Ang Li ,  Xiaojin Shi

IPC: G06K9/00 ,  H04N13/02 ,  G06K9/46 ,  G06F3/01 ,  G06F3/03 ,  G06F3/042 ,  G06T7/246 ,  G06T7/254 ,  H04N13/00

CPC classification number: G06K9/00355 ,  G06F3/017 ,  G06F3/0304 ,  G06F3/0425 ,  G06K9/4609 ,  G06T7/246 ,  G06T7/254 ,  G06T2200/04 ,  G06T2207/30196 ,  H04N13/207 ,  H04N13/271 ,  H04N2013/0085

Abstract: In the field of Human-computer interaction (HCI), i.e., the study of the interfaces between people (i.e., users) and computers, understanding the intentions and desires of how the user wishes to interact with the computer is a very important problem. The ability to understand human gestures, and, in particular, hand gestures, as they relate to HCI, is a very important aspect in understanding the intentions and desires of the user in a wide variety of applications. In this disclosure, a novel system and method for three-dimensional hand tracking using depth sequences is described. Some of the major contributions of the hand tracking system described herein include: 1.) a robust hand detector that is invariant to scene background changes; 2.) a bi-directional tracking algorithm that prevents detected hands from always drifting closer to the front of the scene (i.e., forward along the z-axis of the scene); and 3.) various hand verification heuristics.

公开(公告)号：US20160048726A1

公开(公告)日：2016-02-18

申请号：US14706649

申请日：2015-05-07

Applicant: Apple Inc.

Inventor： Feng Tang ,  Ang Li ,  Xiaojin Shi

IPC: G06K9/00 ,  G06T7/20 ,  G06K9/46 ,  H04N13/02

CPC classification number: G06K9/00355 ,  G06F3/017 ,  G06F3/0304 ,  G06F3/0425 ,  G06K9/4609 ,  G06T7/246 ,  G06T7/254 ,  G06T2200/04 ,  G06T2207/30196 ,  H04N13/207 ,  H04N13/271 ,  H04N2013/0085

Abstract: In the field of Human-computer interaction (HCI), i.e., the study of the interfaces between people (i.e., users) and computers, understanding the intentions and desires of how the user wishes to interact with the computer is a very important problem. The ability to understand human gestures, and, in particular, hand gestures, as they relate to HCI, is a very important aspect in understanding the intentions and desires of the user in a wide variety of applications. In this disclosure, a novel system and method for three-dimensional hand tracking using depth sequences is described. Some of the major contributions of the hand tracking system described herein include: 1.) a robust hand detector that is invariant to scene background changes; 2.) a bi-directional tracking algorithm that prevents detected hands from always drifting closer to the front of the scene (i.e., forward along the z-axis of the scene); and 3.) various hand verification heuristics.

Abstract translation: 在人机互动（HCI）领域，即研究人（即用户）和计算机之间的界面，理解用户希望如何与计算机交互的意图和欲望是非常重要的问题。 了解人类手势，特别是手势，因为它们与HCI相关的能力在理解用户在各种应用中的意图和欲望方面是一个非常重要的方面。 在本公开中，描述了使用深度序列的三维手跟踪的新颖系统和方法。 本文描述的手持跟踪系统的一些主要贡献包括：1.）对场景背景变化不变的鲁棒手指检测器; 2.）双向跟踪算法，其防止检测到的手总是漂移到靠近场景的前方（即，沿着场景的z轴向前）; 和3.）各种手验证启发式。