Fully Automatic Dynamic Articulated Model Calibration
    11.
    发明申请
    Fully Automatic Dynamic Articulated Model Calibration 有权
    全自动动态铰接式校准

    公开(公告)号:US20120327089A1

    公开(公告)日:2012-12-27

    申请号:US13172255

    申请日:2011-06-29

    IPC分类号: G06T13/40

    CPC分类号: G06T17/00 G06T13/40

    摘要: A depth sensor obtains images of articulated portions of a user's body such as the hand. A predefined model of the articulated body portions is provided. The model is matched to corresponding depth pixels which are obtained from the depth sensor, to provide an initial match. The initial match is then refined using distance constraints, collision constraints, angle constraints and a pixel comparison using a rasterized model. Distance constraints include constraints on distances between the articulated portions of the hand. Collision constraints can be enforced when the model meets specified conditions, such as when at least two adjacent finger segments of the model are determined to be in a specified relative position, e.g., parallel. The rasterized model includes depth pixels of the model which are compared to identify overlapping pixels. Dimension of the articulated portions of the model are individually adjusted.

    摘要翻译: 深度传感器获得诸如手的用户身体的关节部分的图像。 提供了铰接体部分的预定模型。 该模型与从深度传感器获得的相应深度像素匹配,以提供初始匹配。 然后使用距离约束,碰撞约束,角度约束和使用光栅化模型的像素比较来精简初始匹配。 距离约束包括对手的铰接部分之间距离的约束。 当模型满足指定的条件时,例如当模型的至少两个相邻手指段被确定为处于指定的相对位置(例如并行)时,可以强制执行冲突约束。 光栅化模型包括与识别重叠像素进行比较的模型的深度像素。 模型的铰接部分的尺寸被单独调整。

    Planar surface detection
    12.
    发明授权
    Planar surface detection 有权
    平面检测

    公开(公告)号:US09070194B2

    公开(公告)日:2015-06-30

    申请号:US13660948

    申请日:2012-10-25

    IPC分类号: G06T15/40 G06T7/00

    摘要: A planar surface within a physical environment is detected enabling presentation of a graphical user interface overlaying the planar surface. Detection of planar surfaces may be performed, in one example, by obtaining a collection of three-dimensional surface points of a physical environment imaged via an optical sensor subsystem. A plurality of polygon sets of points are sampled within the collection. Each polygon set of points includes three or more localized points of the collection that defines a polygon. Each polygon is classified into one or more groups of polygons having a shared planar characteristic with each other polygon of that group. One or more planar surfaces within the collection are identified such that each planar surface is at least partially defined by a group of polygons containing at least a threshold number of polygons.

    摘要翻译: 检测物理环境内的平坦表面,使得能够呈现覆盖平面表面的图形用户界面。 在一个示例中,可以通过获得经由光学传感器子系统成像的物理环境的三维表面点的集合来执行平面表面的检测。 在集合内采样多个多边形集合点。 每个多边形集合点包括定义多边形的集合的三个或更多个局部点。 每个多边形被分成具有与该组的每个其他多边形共享的平面特征的一组或多组多边形。 识别集合内的一个或多个平面表面,使得每个平面表面至少部分地由包含至少一个阈值数量的多边形的一组多边形限定。

    TWO-HAND INTERACTION WITH NATURAL USER INTERFACE
    13.
    发明申请
    TWO-HAND INTERACTION WITH NATURAL USER INTERFACE 有权
    与自然用户界面的双手相互作用

    公开(公告)号:US20150040040A1

    公开(公告)日:2015-02-05

    申请号:US13959555

    申请日:2013-08-05

    摘要: Two-handed interactions with a natural user interface are disclosed. For example, one embodiment provides a method comprising detecting via image data received by the computing device a context-setting input performed by a first hand of a user. and sending to a display a user interface positioned based on a virtual interaction coordinate system, the virtual coordinate system being positioned based upon a position of the first hand of the user. The method further includes detecting via image data received by the computing device an action input performed by a second hand of the user, the action input performed while the first hand of the user is performing the context-setting input, and sending to the display a response based on the context-setting input and an interaction between the action input and the virtual interaction coordinate system.

    摘要翻译: 公开了与自然用户界面的双手交互。 例如,一个实施例提供了一种方法,包括通过由计算设备接收的图像数据检测由用户的第一只手执行的上下文设置输入。 并且向显示器发送基于虚拟交互坐标系定位的用户界面,所述虚拟坐标系基于所述用户的第一只手的位置来定位。 该方法还包括通过由计算设备接收的图像数据检测由用户的第二只手执行的动作输入,当用户的第一只手执行上下文设置输入时执行的动作输入,并且向显示器发送 基于上下文设置输入的响应和动作输入与虚拟交互坐标系之间的交互。

    Invariant features for computer vision
    18.
    发明授权
    Invariant features for computer vision 有权
    计算机视觉的不变特征

    公开(公告)号:US08878906B2

    公开(公告)日:2014-11-04

    申请号:US13688120

    申请日:2012-11-28

    摘要: Technology is described for determining and using invariant features for computer vision. A local orientation may be determined for each depth pixel in a subset of the depth pixels in a depth map. The local orientation may an in-plane orientation, an out-out-plane orientation or both. A local coordinate system is determined for each of the depth pixels in the subset based on the local orientation of the corresponding depth pixel. A feature region is defined relative to the local coordinate system for each of the depth pixels in the subset. The feature region for each of the depth pixels in the subset is transformed from the local coordinate system to an image coordinate system of the depth map. The transformed feature regions are used to process the depth map.

    摘要翻译: 描述了用于确定和使用计算机视觉的不变特征的技术。 可以针对深度图中的深度像素的子集中的每个深度像素确定局部取向。 局部取向可以是面内取向,面外取向或两者。 基于相应深度像素的局部方向,为子集中的每个深度像素确定局部坐标系。 相对于子集中的每个深度像素的局部坐标系定义特征区域。 子集中的每个深度像素的特征区域从局部坐标系变换为深度图的图像坐标系。 变换的特征区域用于处理深度图。