公开(公告)号：US20140300539A1

公开(公告)日：2014-10-09

申请号：US14271191

申请日：2014-05-06

申请人： Xiaofeng Tong ,  Dayong Ding ,  Wenlong Li ,  Yimin Zhang

发明人： Xiaofeng Tong ,  Dayong Ding ,  Wenlong Li ,  Yimin Zhang

IPC分类号： G06K9/00 ,  G06F3/01

CPC分类号： G06K9/00355 ,  G06F3/017 ,  G06K9/00228 ,  G06K9/00261

摘要： Methods, apparatuses, and articles associated with gesture recognition using depth images are disclosed herein. In various embodiments, an apparatus may include a face detection engine configured to determine whether a face is present in one or more gray images of respective image frames generated by a depth camera, and a hand tracking engine configured to track a hand in one or more depth images generated by the depth camera. The apparatus may further include a feature extraction and gesture inference engine configured to extract features based on results of the tracking by the hand tracking engine, and infer a hand gesture based at least in part on the extracted features. Other embodiments may also be disclosed and claimed.

公开(公告)号：US20130278504A1

公开(公告)日：2013-10-24

申请号：US13977248

申请日：2011-11-01

申请人： Xiaofeng Tong ,  Dayong Ding ,  Wenlong Li

发明人： Xiaofeng Tong ,  Dayong Ding ,  Wenlong Li

IPC分类号： G06F3/01

CPC分类号： G06F3/017 ,  G06K9/00355

摘要： Systems, devices and methods are described including starting a gesture recognition engine in response to detecting an initiation gesture and using the gesture recognition engine to determine a hand posture and a hand trajectory in various depth images. The gesture recognition engine may then use the hand posture and the hand trajectory to recognize a dynamic hand gesture and provide corresponding user interface command.

摘要翻译： 描述了系统，设备和方法，包括响应于检测到启动手势而启动手势识别引擎，并使用手势识别引擎确定各种深度图像中的手势和手轨迹。 手势识别引擎然后可以使用手势和手迹来识别动态手势并提供对应的用户界面命令。

公开(公告)号：US20140037134A1

公开(公告)日：2014-02-06

申请号：US13387221

申请日：2011-04-11

申请人： Xiaofeng Tong ,  Dayong Ding ,  Wenlong Li ,  Yimin Zhang

发明人： Xiaofeng Tong ,  Dayong Ding ,  Wenlong Li ,  Yimin Zhang

IPC分类号： G06K9/00

CPC分类号： G06K9/00355 ,  G06F3/017 ,  G06K9/00228 ,  G06K9/00261

摘要： Methods, apparatuses, and articles associated with gesture recognition using depth images are disclosed herein. In various embodiments, an apparatus may include a face detection engine configured to determine whether a face is present in one or more gray images of respective image frames generated by a depth camera, and a hand tracking engine configured to track a hand in one or more depth images generated by the depth camera. The apparatus may further include a feature extraction and gesture inference engine configured to extract features based on results of the tracking by the hand tracking engine, and infer a hand gesture based at least in part on the extracted features. Other embodiments may also be disclosed and claimed.

摘要翻译： 本文公开了使用深度图像与手势识别相关联的方法，装置和文章。 在各种实施例中，装置可以包括面部检测引擎，其被配置为确定面部是否存在于由深度相机产生的各个图像帧的一个或多个灰度图像中，以及手动跟踪引擎，其配置成在一个或多个 由深度相机产生的深度图像。 该装置还可以包括特征提取和手势推断引擎，其被配置为基于手跟踪引擎的跟踪结果来提取特征，以及至少部分地基于所提取的特征推断手势。 也可以公开和要求保护其他实施例。

公开(公告)号：US09164589B2

公开(公告)日：2015-10-20

申请号：US13977248

申请日：2011-11-01

申请人： Xiaofeng Tong ,  Dayong Ding ,  Wenlong Li

发明人： Xiaofeng Tong ,  Dayong Ding ,  Wenlong Li

IPC分类号： G09G5/00 ,  G06F3/01 ,  G06K9/00

CPC分类号： G06F3/017 ,  G06K9/00355

摘要： Systems, devices and methods are described including starting a gesture recognition engine in response to detecting an initiation gesture and using the gesture recognition engine to determine a hand posture and a hand trajectory in various depth images. The gesture recognition engine may then use the hand posture and the hand trajectory to recognize a dynamic hand gesture and provide corresponding user interface command.

摘要翻译： 描述了系统，设备和方法，包括响应于检测到启动手势而启动手势识别引擎，并使用手势识别引擎确定各种深度图像中的手势和手轨迹。 手势识别引擎然后可以使用手势和手迹来识别动态手势并提供对应的用户界面命令。

公开(公告)号：US08718327B2

公开(公告)日：2014-05-06

申请号：US13387221

申请日：2011-04-11

申请人： Xiaofeng Tong ,  Dayong Ding ,  Wenlong Li ,  Yimin Zhang

发明人： Xiaofeng Tong ,  Dayong Ding ,  Wenlong Li ,  Yimin Zhang

IPC分类号： G06K9/00

CPC分类号： G06K9/00355 ,  G06F3/017 ,  G06K9/00228 ,  G06K9/00261

摘要： Methods, apparatuses, and articles associated with gesture recognition using depth images are disclosed herein. In various embodiments, an apparatus may include a face detection engine configured to determine whether a face is present in one or more gray images of respective image frames generated by a depth camera, and a hand tracking engine configured to track a hand in one or more depth images generated by the depth camera. The apparatus may further include a feature extraction and gesture inference engine configured to extract features based on results of the tracking by the hand tracking engine, and infer a hand gesture based at least in part on the extracted features. Other embodiments may also be disclosed and claimed.

摘要翻译： 本文公开了使用深度图像与手势识别相关联的方法，装置和文章。 在各种实施例中，装置可以包括面部检测引擎，其被配置为确定面部是否存在于由深度相机产生的各个图像帧的一个或多个灰度图像中，以及手动跟踪引擎，其配置成在一个或多个 由深度相机产生的深度图像。 该装置还可以包括特征提取和手势推断引擎，其被配置为基于手跟踪引擎的跟踪结果来提取特征，以及至少部分地基于所提取的特征推断手势。 也可以公开和要求保护其他实施例。

公开(公告)号：US20130276029A1

公开(公告)日：2013-10-17

申请号：US13994764

申请日：2011-09-12

申请人： Wenlong Li ,  Dayong Ding ,  Xiaofeng Tong ,  Yangzhou Du ,  Peng Wang

发明人： Wenlong Li ,  Dayong Ding ,  Xiaofeng Tong ,  Yangzhou Du ,  Peng Wang

IPC分类号： H04N21/482

CPC分类号： H04N21/482 ,  G06F16/40 ,  H04N21/25891 ,  H04N21/4126 ,  H04N21/4183 ,  H04N21/4223 ,  H04N21/44008 ,  H04N21/44218 ,  H04N21/4722 ,  H04N21/4788 ,  H04N21/632

摘要： In response to a gestural command, a video currently being watched can be identified by extracting at least one decoded frame from a television transmission. The frame can be transmitted to a separate mobile device for requesting an image search and for receiving the search results. The search results can be used to obtain more information. The user's social networking friends can also be contacted to obtain more information about the clip.

摘要翻译： 响应于手势命令，可以通过从电视传输中提取至少一个解码的帧来识别当前正在观看的视频。 该帧可以被发送到单独的移动设备，用于请求图像搜索和接收搜索结果。 搜索结果可用于获取更多信息。 还可以联系用户的社交网络朋友以获取有关剪辑的更多信息。

公开(公告)号：US08781221B2

公开(公告)日：2014-07-15

申请号：US13574823

申请日：2011-04-11

申请人： Dayong Ding ,  Wenlong Li ,  Yimin Zhang ,  Xiaofeng Tong ,  Jianguo Li

发明人： Dayong Ding ,  Wenlong Li ,  Yimin Zhang ,  Xiaofeng Tong ,  Jianguo Li

IPC分类号： G06K9/34

CPC分类号： G06K9/00355 ,  G06F3/017 ,  G06K9/00228 ,  G06K9/4652 ,  G06K9/6272

摘要： A cost-effective and computationally efficient hand gesture recognition system for detecting and/or tracking a face region and/or a hand region in a series of images. A skin segmentation model is updated with skin pixel information from the face and iteratively applied to the pixels in the hand region, to more accurately identify the pixels in the hand region given current lighting conditions around the image. Shape features are then extracted from the image, and based on the shape features, a hand gesture is identified in the image. The identified hand gesture may be used to generate a command signal to control the operation of an application or system.

摘要翻译： 一种用于在一系列图像中检测和/或跟踪面部区域和/或手区域的经济有效且计算效率高的手势识别系统。 使用来自脸部的皮肤像素信息更新皮肤分割模型，并迭代地应用于手区域中的像素，以便在图像周围的当前照明条件下更准确地识别手区域中的像素。 然后从图像中提取形状特征，并且基于形状特征，在图像中识别手势。 可以使用所识别的手势来产生用于控制应用或系统的操作的命令信号。

公开(公告)号：US09589357B2

公开(公告)日：2017-03-07

申请号：US14127457

申请日：2013-06-04

申请人： INTEL CORPORATION ,  Wenlong Li ,  Yangzhou Du ,  Xiaofeng Tong

发明人： Wenlong Li ,  Yangzhou Du ,  Xiaofeng Tong

IPC分类号： G06T15/00 ,  G06T7/00 ,  G06T13/40 ,  H04N7/14 ,  H04N7/15 ,  G06K9/00 ,  G06T13/80

CPC分类号： G06T7/73 ,  G06K9/00281 ,  G06K9/00315 ,  G06T13/40 ,  G06T13/80 ,  G06T2207/30201 ,  H04N7/147 ,  H04N7/157

摘要： Techniques are disclosed for performing avatar-based video encoding. In some embodiments, a video recording of an individual may be encoded utilizing an avatar that is driven by the facial expression(s) of the individual. In some such cases, the resultant avatar animation may accurately mimic facial expression(s) of the recorded individual. Some embodiments can be used, for example, in video sharing via social media and networking websites. Some embodiments can be used, for example, in video-based communications (e.g., peer-to-peer video calls; videoconferencing). In some instances, use to the disclosed techniques may help to reduce communications bandwidth use, preserve the individual's anonymity, and/or provide enhanced entertainment value (e.g., amusement) for the individual, for example.

摘要翻译： 公开了用于执行基于图像的视频编码的技术。 在一些实施例中，可以使用由个人的面部表情驱动的头像来编码个人的视频记录。 在某些这种情况下，所得到的化身动画可以准确地模拟记录的个人的面部表情。 一些实施例可以用于例如通过社交媒体和网络网站的视频共享。 一些实施例可以用于例如基于视频的通信（例如，对等视频通话;视频会议）中。 在某些情况下，例如，使用所公开的技术可以有助于减少个人的通信带宽使用，保留个人的匿名性和/或提供增强的娱乐价值（例如，娱乐）。

公开(公告)号：US20160006987A1

公开(公告)日：2016-01-07

申请号：US13977278

申请日：2012-09-06

申请人： Wenlong Li ,  Xiaofeng Tong ,  Yangzhou Du ,  Wei Hu ,  Yimin Zhang

发明人： Wenlong Li ,  Xiaofeng Tong ,  Yangzhou Du ,  Wei Hu ,  Yimin Zhang

IPC分类号： H04N7/15 ,  G06K9/00 ,  H04N7/14

CPC分类号： H04N7/157 ,  G06K9/00302 ,  H04L12/1827 ,  H04N7/147 ,  H04N7/155

摘要： A video communication system that replaces actual live images of the participating users with animated avatars. A method may include initiating communication between a first user device and a remote user device; receiving selection of a new avatar to represent a user of the first user device; identifying a new avatar file for the new avatar in an avatar database associated with the first user device; determining that the new avatar file is not present in a remote avatar database associated with the remote user device; and transmitting the new avatar file to the remote avatar database in response to determining that the new avatar file is not present in the remote avatar database.

摘要翻译： 视频通信系统，用动画头像代替参与用户的实际实况图像。 方法可以包括发起第一用户设备和远程用户设备之间的通信; 接收用于表示所述第一用户设备的用户的新化身的选择; 在与所述第一用户设备相关联的化身数据库中识别所述新化身的新头像文件; 确定所述新的化身文件不存在于与所述远程用户设备相关联的远程化身数据库中; 以及响应于确定所述新化身文件不存在于所述远程化身数据库中，将所述新化身文件发送到所述远程化身数据库。

公开(公告)号：US20140218371A1

公开(公告)日：2014-08-07

申请号：US13997271

申请日：2012-12-17

申请人： Yangzhou Du ,  Wenlong Li ,  Xiaofeng Tong ,  Wei Hu ,  Yimin Zhang

发明人： Yangzhou Du ,  Wenlong Li ,  Xiaofeng Tong ,  Wei Hu ,  Yimin Zhang

IPC分类号： G06T13/80

CPC分类号： G06T13/40 ,  G06K9/00315 ,  G06T13/80 ,  H04N7/157

摘要： Avatars are animated using predetermined avatar images that are selected based on facial features of a user extracted from video of the user. A user's facial features are tracked in a live video, facial feature parameters are determined from the tracked features, and avatar images are selected based on the facial feature parameters. The selected images are then displayed are sent to another device for display. Selecting and displaying different avatar images as a user's facial movements change animates the avatar. An avatar image can be selected from a series of avatar images representing a particular facial movement, such as blinking. An avatar image can also be generated from multiple avatar feature images selected from multiple avatar feature image series associated with different regions of a user's face (eyes, mouth, nose, eyebrows), which allows different regions of the avatar to be animated independently.

摘要翻译： 使用基于从用户的视频提取的用户的面部特征来选择的预定化身图像来动画化身。 在实时视频中跟踪用户的面部特征，根据跟踪的特征确定面部特征参数，并且基于面部特征参数选择头像图像。 然后将所选择的图像显示发送到另一个设备进行显示。 选择和显示不同的头像图像作为用户的面部动作变化动画化身。 可以从代表特定面部运动的一系列化身图像中选择化身图像，例如闪烁。 还可以从从用户脸部（眼睛，嘴，鼻，眉毛）的不同区域相关联的多个化身特征图像系列中选择的多个化身特征图像中生成化身图像，其允许化身的不同区域独立地动画化。