-
公开(公告)号:US08929612B2
公开(公告)日:2015-01-06
申请号:US13299857
申请日:2011-11-18
申请人: Anthony Ambrus , Kyungsuk David Lee , Andrew Campbell , David Haley , Brian Mount , Albert Robles , Daniel Osborn , Shawn Wright , Nahil Sharkasi , Dave Hill , Daniel McCulloch , Alexandru Balan
发明人: Anthony Ambrus , Kyungsuk David Lee , Andrew Campbell , David Haley , Brian Mount , Albert Robles , Daniel Osborn , Shawn Wright , Nahil Sharkasi , Dave Hill , Daniel McCulloch , Alexandru Balan
IPC分类号: G06K9/00
CPC分类号: G06K9/00375 , G06K9/00362 , G06K9/48
摘要: A system and method are disclosed relating to a pipeline for generating a computer model of a target user, including a hand model of the user's hands, captured by an image sensor in a NUI system. The computer model represents a best estimate of the position of a user's hand or hands and whether the hand or hand is in an open or closed state. The generated hand model may be used by a gaming or other application to determine such things as user gestures and control actions.
摘要翻译: 公开了一种用于生成目标用户的计算机模型的管道的系统和方法,其包括由NUI系统中的图像传感器捕获的用户的手的手模型。 计算机模型代表用户手或手的位置以及手或手是处于打开状态还是关闭状态的最佳估计。 生成的手模型可以被游戏或其他应用程序用于确定诸如用户手势和控制动作之类的事物。
-
公开(公告)号:US20120308140A1
公开(公告)日:2012-12-06
申请号:US13299857
申请日:2011-11-18
申请人: Anthony Ambrus , Kyungsuk David Lee , Andrew Campbell , David Haley , Brian Mount , Albert Robles , Daniel Osborn , Shawn Wright , Nahil Sharkasi , Dave Hill , Daniel McCulloch , Alexandru Balan
发明人: Anthony Ambrus , Kyungsuk David Lee , Andrew Campbell , David Haley , Brian Mount , Albert Robles , Daniel Osborn , Shawn Wright , Nahil Sharkasi , Dave Hill , Daniel McCulloch , Alexandru Balan
IPC分类号: G06K9/46
CPC分类号: G06K9/00375 , G06K9/00362 , G06K9/48
摘要: A system and method are disclosed relating to a pipeline for generating a computer model of a target user, including a hand model of the user's hands, captured by an image sensor in a NUI system. The computer model represents a best estimate of the position of a user's hand or hands and whether the hand or hand is in an open or closed state. The generated hand model may be used by a gaming or other application to determine such things as user gestures and control actions.
摘要翻译: 公开了一种用于生成目标用户的计算机模型的管道的系统和方法,其包括由NUI系统中的图像传感器捕获的用户的手的手模型。 计算机模型代表用户手或手的位置以及手或手是处于打开状态还是关闭状态的最佳估计。 生成的手模型可以被游戏或其他应用程序用于确定诸如用户手势和控制动作之类的事物。
-
公开(公告)号:US08897491B2
公开(公告)日:2014-11-25
申请号:US13277011
申请日:2011-10-19
申请人: Anthony Ambrus , Kyungsuk David Lee , Andrew Campbell , David Haley , Brian Mount , Albert Robles , Daniel Osborn , Shawn Wright , Nahil Sharkasi , Dave Hill , Daniel McCulloch
发明人: Anthony Ambrus , Kyungsuk David Lee , Andrew Campbell , David Haley , Brian Mount , Albert Robles , Daniel Osborn , Shawn Wright , Nahil Sharkasi , Dave Hill , Daniel McCulloch
IPC分类号: G06K9/00 , G06F3/042 , A63F13/40 , A63F13/20 , G06F3/0488
CPC分类号: A63F13/428 , A63F13/06 , A63F13/10 , A63F13/213 , A63F2300/1087 , A63F2300/6045 , A63F2300/6607 , G06F3/0425 , G06F3/04883 , G06K9/00355 , G06K9/00389
摘要: A system and method are disclosed relating to a pipeline for generating a computer model of a target user, including a hand model of the user's hands and fingers, captured by an image sensor in a NUI system. The computer model represents a best estimate of the position and orientation of a user's hand or hands. The generated hand model may be used by a gaming or other application to determine such things as user gestures and control actions.
摘要翻译: 公开了一种用于生成目标用户的计算机模型的管道的系统和方法,包括用户的手和手指的手型,由NUI系统中的图像传感器捕获。 计算机模型代表用户手或手的位置和方向的最佳估计。 生成的手模型可以被游戏或其他应用程序用于确定诸如用户手势和控制动作之类的事物。
-
公开(公告)号:US20120309532A1
公开(公告)日:2012-12-06
申请号:US13277011
申请日:2011-10-19
申请人: Anthony Ambrus , Kyungsuk David Lee , Andrew Campbell , David Haley , Brian Mount , Albert Robles , Daniel Osborn , Shawn Wright , Nahil Sharkasi , Dave Hill , Daniel McCulloch
发明人: Anthony Ambrus , Kyungsuk David Lee , Andrew Campbell , David Haley , Brian Mount , Albert Robles , Daniel Osborn , Shawn Wright , Nahil Sharkasi , Dave Hill , Daniel McCulloch
IPC分类号: A63F13/06
CPC分类号: A63F13/428 , A63F13/06 , A63F13/10 , A63F13/213 , A63F2300/1087 , A63F2300/6045 , A63F2300/6607 , G06F3/0425 , G06F3/04883 , G06K9/00355 , G06K9/00389
摘要: A system and method are disclosed relating to a pipeline for generating a computer model of a target user, including a hand model of the user's hands and fingers, captured by an image sensor in a NUI system. The computer model represents a best estimate of the position and orientation of a user's hand or hands. The generated hand model may be used by a gaming or other application to determine such things as user gestures and control actions.
摘要翻译: 公开了一种用于生成目标用户的计算机模型的管道的系统和方法,包括用户的手和手指的手型,由NUI系统中的图像传感器捕获。 计算机模型代表用户手或手的位置和方向的最佳估计。 生成的手模型可以被游戏或其他应用程序用于确定诸如用户手势和控制动作之类的事物。
-
公开(公告)号:US20140118397A1
公开(公告)日:2014-05-01
申请号:US13660948
申请日:2012-10-25
CPC分类号: G06T7/0057 , G06T7/521 , G06T2207/10028
摘要: A planar surface within a physical environment is detected enabling presentation of a graphical user interface overlaying the planar surface. Detection of planar surfaces may be performed, in one example, by obtaining a collection of three-dimensional surface points of a physical environment imaged via an optical sensor subsystem. A plurality of polygon sets of points are sampled within the collection. Each polygon set of points includes three or more localized points of the collection that defines a polygon. Each polygon is classified into one or more groups of polygons having a shared planar characteristic with each other polygon of that group. One or more planar surfaces within the collection are identified such that each planar surface is at least partially defined by a group of polygons containing at least a threshold number of polygons.
摘要翻译: 检测物理环境内的平坦表面,使得能够呈现覆盖平面表面的图形用户界面。 在一个示例中,可以通过获得经由光学传感器子系统成像的物理环境的三维表面点的集合来执行平面表面的检测。 在集合内采样多个多边形集合点。 每个多边形集合点包括定义多边形的集合的三个或更多个局部点。 每个多边形被分成具有与该组的每个其他多边形共享的平面特征的一组或多组多边形。 识别集合内的一个或多个平面表面,使得每个平面表面至少部分地由包含至少一个阈值数量的多边形的一组多边形限定。
-
公开(公告)号:US08610723B2
公开(公告)日:2013-12-17
申请号:US13172255
申请日:2011-06-29
IPC分类号: G06T13/00
摘要: A depth sensor obtains images of articulated portions of a user's body such as the hand. A predefined model of the articulated body portions is provided. The model is matched to corresponding depth pixels which are obtained from the depth sensor, to provide an initial match. The initial match is then refined using distance constraints, collision constraints, angle constraints and a pixel comparison using a rasterized model. Distance constraints include constraints on distances between the articulated portions of the hand. Collision constraints can be enforced when the model meets specified conditions, such as when at least two adjacent finger segments of the model are determined to be in a specified relative position, e.g., parallel. The rasterized model includes depth pixels of the model which are compared to identify overlapping pixels. Dimension of the articulated portions of the model are individually adjusted.
摘要翻译: 深度传感器获得诸如手的用户身体的关节部分的图像。 提供了铰接体部分的预定模型。 该模型与从深度传感器获得的相应深度像素匹配,以提供初始匹配。 然后使用距离约束,碰撞约束,角度约束和使用光栅化模型的像素比较来精简初始匹配。 距离约束包括对手的铰接部分之间距离的约束。 当模型满足指定的条件时,例如当模型的至少两个相邻手指段被确定为处于指定的相对位置(例如并行)时,可以强制执行冲突约束。 光栅化模型包括与识别重叠像素进行比较的模型的深度像素。 模型的铰接部分的尺寸被单独调整。
-
公开(公告)号:US20130329011A1
公开(公告)日:2013-12-12
申请号:US13688064
申请日:2012-11-28
CPC分类号: H04N13/275 , G06F3/011 , G06F3/017 , G06T7/75 , G06T17/00 , G06T19/20 , G06T2200/04 , G06T2207/10028 , G06T2207/30196 , G06T2219/2016 , H04N13/271
摘要: A depth sensor obtains images of articulated portions of a user's body such as the hand. A predefined model of the articulated body portions is provided. Representative attract points of the model are matched to centroids of the depth sensor data, and a rigid transform of the model is performed, in an initial, relatively coarse matching process. This matching process is then refined in a non-rigid transform of the model, using attract point-to-centroid matching. In a further refinement, an iterative process rasterizes the model to provide depth pixels of the model, and compares the depth pixels of the model to the depth pixels of the depth sensor. The refinement is guided by whether the depth pixels of the model are overlapping or non-overlapping with the depth pixels of the depth sensor. Collision, distance and angle constraints are also imposed on the model.
摘要翻译: 深度传感器获得诸如手的用户身体的关节部分的图像。 提供了铰接体部分的预定模型。 模型的代表性吸引点与深度传感器数据的质心相匹配,并且在初始的较粗略的匹配过程中执行模型的刚性变换。 然后,使用吸引点到质心匹配,在模型的非刚性变换中对该匹配过程进行细化。 在进一步的细化中,迭代过程光栅化模型以提供模型的深度像素,并将模型的深度像素与深度传感器的深度像素进行比较。 细化是由模型的深度像素是否与深度传感器的深度像素重叠或不重叠来指导。 对模型也施加了碰撞,距离和角度限制。
-
公开(公告)号:US20130141597A1
公开(公告)日:2013-06-06
申请号:US13312846
申请日:2011-12-06
CPC分类号: G06T7/2046 , G06K9/00362 , G06T7/194 , G06T7/251 , G06T2207/10016 , G06T2207/20224 , G06T2207/30196 , H04N5/23219 , H04N5/23241 , H04N5/23254 , H04N5/2354 , H04N5/345
摘要: Embodiments related to detecting object information from image data collected by an image sensor are disclosed. In one example embodiment, the object information is detected by receiving a frame of image data from the image sensor and detecting a change in a threshold condition related to an object within the frame. The embodiment further comprises adjusting a setting that changes a power consumption of the image sensor in response to detecting the threshold condition.
摘要翻译: 公开了从由图像传感器收集的图像数据检测对象信息的实施例。 在一个示例实施例中,通过从图像传感器接收图像数据的帧并检测与帧内的对象相关的阈值条件的变化来检测对象信息。 该实施例还包括响应于检测阈值条件来调整改变图像传感器的功耗的设置。
-
公开(公告)号:US20160132786A1
公开(公告)日:2016-05-12
申请号:US14539778
申请日:2014-11-12
申请人: Alexandru Balan , Bradford Jason Snow , Christopher Douglas Edmonds , Henry Nelson Jerez , Kyungsuk David Lee , Mark J. Finocchio , Miguel Susffalich , Cem Keskin
发明人: Alexandru Balan , Bradford Jason Snow , Christopher Douglas Edmonds , Henry Nelson Jerez , Kyungsuk David Lee , Mark J. Finocchio , Miguel Susffalich , Cem Keskin
IPC分类号: G06N99/00
CPC分类号: G06N20/00
摘要: Various embodiments relating to partitioning a data set for training machine-learning classifiers based on an output of a globally trained machine-learning classifier are disclosed. In one embodiment, a first machine-learning classifier may be trained on a set of training data to produce a corresponding set of output data. The set of training data may be partitioned into a plurality of subsets based on the set of output data. Each subset may correspond to a different class. A second machine-learning classifier may be trained on the set of training data using a plurality of classes corresponding to the plurality of subsets to produce, for each data object of the set of training data, a probability distribution having for each class a probability that the data object is a member of the class.
摘要翻译: 公开了关于根据全球训练的机器学习分类器的输出划分用于训练机器学习分类器的数据集的各种实施例。 在一个实施例中,可以对一组训练数据对第一机器学习分类器进行训练,以产生相应的一组输出数据。 该组训练数据可以基于该组输出数据被划分成多个子集。 每个子集可以对应于不同的类。 可以使用对应于多个子集的多个类来对该组训练数据对第二机器学习分类器进行训练,以针对该组训练数据的每个数据对象产生对于每个类具有以下概率的概率: 数据对象是该类的成员。
-
公开(公告)号:US09171380B2
公开(公告)日:2015-10-27
申请号:US13312846
申请日:2011-12-06
CPC分类号: G06T7/2046 , G06K9/00362 , G06T7/194 , G06T7/251 , G06T2207/10016 , G06T2207/20224 , G06T2207/30196 , H04N5/23219 , H04N5/23241 , H04N5/23254 , H04N5/2354 , H04N5/345
摘要: Embodiments related to detecting object information from image data collected by an image sensor are disclosed. In one example embodiment, the object information is detected by receiving a frame of image data from the image sensor and detecting a change in a threshold condition related to an object within the frame. The embodiment further comprises adjusting a setting that changes a power consumption of the image sensor in response to detecting the threshold condition.
摘要翻译: 公开了从由图像传感器收集的图像数据检测对象信息的实施例。 在一个示例实施例中,通过从图像传感器接收图像数据的帧并检测与帧内的对象相关的阈值条件的变化来检测对象信息。 该实施例还包括响应于检测阈值条件来调整改变图像传感器的功耗的设置。
-
-
-
-
-
-
-
-
-