-
公开(公告)号:US20120327089A1
公开(公告)日:2012-12-27
申请号:US13172255
申请日:2011-06-29
IPC分类号: G06T13/40
摘要: A depth sensor obtains images of articulated portions of a user's body such as the hand. A predefined model of the articulated body portions is provided. The model is matched to corresponding depth pixels which are obtained from the depth sensor, to provide an initial match. The initial match is then refined using distance constraints, collision constraints, angle constraints and a pixel comparison using a rasterized model. Distance constraints include constraints on distances between the articulated portions of the hand. Collision constraints can be enforced when the model meets specified conditions, such as when at least two adjacent finger segments of the model are determined to be in a specified relative position, e.g., parallel. The rasterized model includes depth pixels of the model which are compared to identify overlapping pixels. Dimension of the articulated portions of the model are individually adjusted.
摘要翻译: 深度传感器获得诸如手的用户身体的关节部分的图像。 提供了铰接体部分的预定模型。 该模型与从深度传感器获得的相应深度像素匹配,以提供初始匹配。 然后使用距离约束,碰撞约束,角度约束和使用光栅化模型的像素比较来精简初始匹配。 距离约束包括对手的铰接部分之间距离的约束。 当模型满足指定的条件时,例如当模型的至少两个相邻手指段被确定为处于指定的相对位置(例如并行)时,可以强制执行冲突约束。 光栅化模型包括与识别重叠像素进行比较的模型的深度像素。 模型的铰接部分的尺寸被单独调整。
-
公开(公告)号:US09070194B2
公开(公告)日:2015-06-30
申请号:US13660948
申请日:2012-10-25
CPC分类号: G06T7/0057 , G06T7/521 , G06T2207/10028
摘要: A planar surface within a physical environment is detected enabling presentation of a graphical user interface overlaying the planar surface. Detection of planar surfaces may be performed, in one example, by obtaining a collection of three-dimensional surface points of a physical environment imaged via an optical sensor subsystem. A plurality of polygon sets of points are sampled within the collection. Each polygon set of points includes three or more localized points of the collection that defines a polygon. Each polygon is classified into one or more groups of polygons having a shared planar characteristic with each other polygon of that group. One or more planar surfaces within the collection are identified such that each planar surface is at least partially defined by a group of polygons containing at least a threshold number of polygons.
摘要翻译: 检测物理环境内的平坦表面,使得能够呈现覆盖平面表面的图形用户界面。 在一个示例中,可以通过获得经由光学传感器子系统成像的物理环境的三维表面点的集合来执行平面表面的检测。 在集合内采样多个多边形集合点。 每个多边形集合点包括定义多边形的集合的三个或更多个局部点。 每个多边形被分成具有与该组的每个其他多边形共享的平面特征的一组或多组多边形。 识别集合内的一个或多个平面表面,使得每个平面表面至少部分地由包含至少一个阈值数量的多边形的一组多边形限定。
-
公开(公告)号:US20150040040A1
公开(公告)日:2015-02-05
申请号:US13959555
申请日:2013-08-05
IPC分类号: G06F3/0484 , G06F3/0481 , G06T19/00 , G06F3/0482
CPC分类号: G06F3/04847 , G06F3/011 , G06F3/017 , G06F3/0304 , G06F3/04812 , G06F3/04815 , G06F3/0482 , G06F3/04842 , G06T19/006
摘要: Two-handed interactions with a natural user interface are disclosed. For example, one embodiment provides a method comprising detecting via image data received by the computing device a context-setting input performed by a first hand of a user. and sending to a display a user interface positioned based on a virtual interaction coordinate system, the virtual coordinate system being positioned based upon a position of the first hand of the user. The method further includes detecting via image data received by the computing device an action input performed by a second hand of the user, the action input performed while the first hand of the user is performing the context-setting input, and sending to the display a response based on the context-setting input and an interaction between the action input and the virtual interaction coordinate system.
摘要翻译: 公开了与自然用户界面的双手交互。 例如,一个实施例提供了一种方法,包括通过由计算设备接收的图像数据检测由用户的第一只手执行的上下文设置输入。 并且向显示器发送基于虚拟交互坐标系定位的用户界面,所述虚拟坐标系基于所述用户的第一只手的位置来定位。 该方法还包括通过由计算设备接收的图像数据检测由用户的第二只手执行的动作输入,当用户的第一只手执行上下文设置输入时执行的动作输入,并且向显示器发送 基于上下文设置输入的响应和动作输入与虚拟交互坐标系之间的交互。
-
公开(公告)号:US20140313225A1
公开(公告)日:2014-10-23
申请号:US13868857
申请日:2013-04-23
IPC分类号: G06T19/00
CPC分类号: G06T19/006 , G03H1/0005 , G06Q30/00 , G06Q30/0261 , G06Q30/08 , G09G3/003 , G09G2340/12 , G09G2340/14 , G09G2354/00
摘要: An augmented reality submission includes a hologram to virtually augment a world space object and a compensation offer for presenting the hologram to a viewer of the world space object. The augmented reality submission is selected as a winning submission if the submission satisfies a selection criteria.
摘要翻译: 增强的现实提交包括全息图,以虚拟地增加世界空间物体和用于将全息图呈现给世界空间物体的观察者的补偿报价。 如果提交的信息满足选择标准,则增强现实提交被选为获胜提交。
-
公开(公告)号:US20130286004A1
公开(公告)日:2013-10-31
申请号:US13458800
申请日:2012-04-27
申请人: Daniel J. McCulloch , Stephen G. Latta , Brian J. Mount , Kevin A. Geisner , Roger Sebastian Kevin Sylvan , Arnulfo Zepeda Navratil , Jason Scott , Jonathan T. Steed , Ben J. Sugden , Britta Silke Hummel , Kyungsuk David Lee , Mark J. Finocchio , Alex Aben-Athar Kipman , Jeffrey N. Margolis
发明人: Daniel J. McCulloch , Stephen G. Latta , Brian J. Mount , Kevin A. Geisner , Roger Sebastian Kevin Sylvan , Arnulfo Zepeda Navratil , Jason Scott , Jonathan T. Steed , Ben J. Sugden , Britta Silke Hummel , Kyungsuk David Lee , Mark J. Finocchio , Alex Aben-Athar Kipman , Jeffrey N. Margolis
IPC分类号: G06T15/00
CPC分类号: G06T19/006 , G06T2210/21
摘要: Technology is described for displaying a collision between objects by an augmented reality display device system. A collision between a real object and a virtual object is identified based on three dimensional space position data of the objects. At least one effect on at least one physical property of the real object is determined based on physical properties of the real object, like a change in surface shape, and physical interaction characteristics of the collision. Simulation image data is generated and displayed simulating the effect on the real object by the augmented reality display. Virtual objects under control of different executing applications can also interact with one another in collisions.
摘要翻译: 描述了用于通过增强现实显示设备系统显示对象之间的冲突的技术。 基于对象的三维空间位置数据来识别真实对象和虚拟对象之间的冲突。 基于真实物体的物理性质,如表面形状的变化和碰撞的物理相互作用特性,确定对真实物体的至少一种物理性质的至少一种影响。 通过增强现实显示模拟图像数据,模拟对真实物体的影响。 在不同执行应用程序的控制下的虚拟对象也可以在冲突中彼此交互。
-
公开(公告)号:US09183676B2
公开(公告)日:2015-11-10
申请号:US13458800
申请日:2012-04-27
申请人: Daniel J. McCulloch , Stephen G. Latta , Brian J. Mount , Kevin A. Geisner , Roger Sebastian Kevin Sylvan , Arnulfo Zepeda Navratil , Jason Scott , Jonathan T. Steed , Ben J. Sugden , Britta Silke Hummel , Kyungsuk David Lee , Mark J. Finocchio , Alex Aben-Athar Kipman , Jeffrey N. Margolis
发明人: Daniel J. McCulloch , Stephen G. Latta , Brian J. Mount , Kevin A. Geisner , Roger Sebastian Kevin Sylvan , Arnulfo Zepeda Navratil , Jason Scott , Jonathan T. Steed , Ben J. Sugden , Britta Silke Hummel , Kyungsuk David Lee , Mark J. Finocchio , Alex Aben-Athar Kipman , Jeffrey N. Margolis
IPC分类号: G06T19/00
CPC分类号: G06T19/006 , G06T2210/21
摘要: Technology is described for displaying a collision between objects by an augmented reality display device system. A collision between a real object and a virtual object is identified based on three dimensional space position data of the objects. At least one effect on at least one physical property of the real object is determined based on physical properties of the real object, like a change in surface shape, and physical interaction characteristics of the collision. Simulation image data is generated and displayed simulating the effect on the real object by the augmented reality display. Virtual objects under control of different executing applications can also interact with one another in collisions.
摘要翻译: 描述了用于通过增强现实显示设备系统显示对象之间的冲突的技术。 基于对象的三维空间位置数据来识别真实对象和虚拟对象之间的冲突。 基于真实物体的物理性质,如表面形状的变化和碰撞的物理相互作用特性,确定对真实物体的至少一种物理性质的至少一种影响。 通过增强现实显示模拟图像数据,模拟对真实物体的影响。 在不同执行应用程序的控制下的虚拟对象也可以在冲突中相互交互。
-
公开(公告)号:US09122053B2
公开(公告)日:2015-09-01
申请号:US13443368
申请日:2012-04-10
申请人: Kevin A. Geisner , Brian J. Mount , Stephen G. Latta , Daniel J. McCulloch , Kyungsuk David Lee , Ben J. Sugden , Jeffrey N. Margolis , Kathryn Stone Perez , Sheridan Martin Small , Mark J. Finocchio , Robert L. Crocco, Jr.
发明人: Kevin A. Geisner , Brian J. Mount , Stephen G. Latta , Daniel J. McCulloch , Kyungsuk David Lee , Ben J. Sugden , Jeffrey N. Margolis , Kathryn Stone Perez , Sheridan Martin Small , Mark J. Finocchio , Robert L. Crocco, Jr.
CPC分类号: G02B27/017 , G02B2027/0127 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G06F3/011 , G06F3/013 , G06F3/165 , G06F3/167 , G06K9/00214 , G06K9/00335 , G06K9/00671 , G06K9/34 , G06T19/006 , H04S7/304 , H04S7/306 , H04S2400/11 , H04S2400/15 , H04S2420/03
摘要: Technology is described for providing realistic occlusion between a virtual object displayed by a head mounted, augmented reality display system and a real object visible to the user's eyes through the display. A spatial occlusion in a user field of view of the display is typically a three dimensional occlusion determined based on a three dimensional space mapping of real and virtual objects. An occlusion interface between a real object and a virtual object can be modeled at a level of detail determined based on criteria such as distance within the field of view, display size or position with respect to a point of gaze. Technology is also described for providing three dimensional audio occlusion based on an occlusion between a real object and a virtual object in the user environment.
摘要翻译: 描述了技术,用于在由头戴式显示器,增强现实显示系统显示的虚拟对象和通过显示器对用户的眼睛可见的真实物体之间提供逼真的遮挡。 显示器的用户视野中的空间遮挡通常是基于实际和虚拟物体的三维空间映射确定的三维遮挡。 可以以基于诸如视场内的距离,相对于凝视点的显示大小或位置的标准确定的细节级别来建模真实对象和虚拟对象之间的遮挡界面。 还描述了用于基于用户环境中的真实对象和虚拟对象之间的遮挡来提供三维音频遮挡的技术。
-
公开(公告)号:US08878906B2
公开(公告)日:2014-11-04
申请号:US13688120
申请日:2012-11-28
申请人: Jamie D. J. Shotton , Mark J. Finocchio , Richard E. Moore , Alexandru O. Balan , Kyungsuk David Lee
发明人: Jamie D. J. Shotton , Mark J. Finocchio , Richard E. Moore , Alexandru O. Balan , Kyungsuk David Lee
CPC分类号: G06K9/6227 , G06F3/017 , G06K9/00201 , G06K9/00375 , H04N13/204
摘要: Technology is described for determining and using invariant features for computer vision. A local orientation may be determined for each depth pixel in a subset of the depth pixels in a depth map. The local orientation may an in-plane orientation, an out-out-plane orientation or both. A local coordinate system is determined for each of the depth pixels in the subset based on the local orientation of the corresponding depth pixel. A feature region is defined relative to the local coordinate system for each of the depth pixels in the subset. The feature region for each of the depth pixels in the subset is transformed from the local coordinate system to an image coordinate system of the depth map. The transformed feature regions are used to process the depth map.
摘要翻译: 描述了用于确定和使用计算机视觉的不变特征的技术。 可以针对深度图中的深度像素的子集中的每个深度像素确定局部取向。 局部取向可以是面内取向,面外取向或两者。 基于相应深度像素的局部方向,为子集中的每个深度像素确定局部坐标系。 相对于子集中的每个深度像素的局部坐标系定义特征区域。 子集中的每个深度像素的特征区域从局部坐标系变换为深度图的图像坐标系。 变换的特征区域用于处理深度图。
-
公开(公告)号:US20100306713A1
公开(公告)日:2010-12-02
申请号:US12474655
申请日:2009-05-29
申请人: Kevin Geisner , Stephen Latta , Gregory N. Snook , Relja Markovic , Arthur Charles Tomlin , Mark Mihelich , Kyungsuk David Lee , David Jason Christopher Horbach , Matthew Jon Puls
发明人: Kevin Geisner , Stephen Latta , Gregory N. Snook , Relja Markovic , Arthur Charles Tomlin , Mark Mihelich , Kyungsuk David Lee , David Jason Christopher Horbach , Matthew Jon Puls
IPC分类号: G06F3/033
CPC分类号: G06F3/017 , G06F3/0481 , G06F3/04847
摘要: Systems, methods and computer readable media are disclosed for a gesture tool. A capture device captures user movement and provides corresponding data to a gesture recognizer engine and an application. From that, the data is parsed to determine whether it satisfies one or more gesture filters, each filter corresponding to user-performed gesture. The data and the information about the filters is also sent to a gesture tool, which displays aspects of the data and filters. In response to user input corresponding to a change in a filter, the gesture tool sends an indication of such to the gesture recognizer engine and application, where that change occurs.
摘要翻译: 公开了用于手势工具的系统,方法和计算机可读介质。 捕获设备捕获用户移动并将相应的数据提供给手势识别器引擎和应用。 从那里,数据被解析以确定它是否满足一个或多个手势滤波器,每个滤波器对应于用户执行的手势。 数据和有关过滤器的信息也被发送到手势工具,该工具显示数据和过滤器的各个方面。 响应于与过滤器的变化相对应的用户输入,手势工具将发生这种变化的指示发送到手势识别器引擎和应用。
-
公开(公告)号:US09008355B2
公开(公告)日:2015-04-14
申请号:US12794388
申请日:2010-06-04
CPC分类号: G06T7/0042 , A63F2300/1087 , A63F2300/8029 , G01S3/786 , G06T7/73 , G06T2207/10028 , H04N13/271
摘要: Automatic depth camera aiming is provided by a method which includes receiving from the depth camera one or more observed depth images of a scene. The method further includes, if a point of interest of a target is found within the scene, determining if the point of interest is within a far range relative to the depth camera. The method further includes, if the point of interest of the target is within the far range, operating the depth camera with a far logic, or if the point of interest of the target is not within the far range, operating the depth camera with a near logic.
摘要翻译: 通过一种方法提供自动深度相机瞄准,其包括从深度摄像机接收一个或多个观察到的场景的深度图像。 该方法还包括如果在场景内找到目标的兴趣点,则确定该兴趣点是否在相对于深度相机的远的范围内。 该方法还包括,如果目标的兴趣点在远的范围内,以远的逻辑操作深度相机,或者如果目标的兴趣点不在远的范围内,则使用 接近逻辑
-
-
-
-
-
-
-
-
-