公开(公告)号：US09524436B2

公开(公告)日：2016-12-20

申请号：US13312869

申请日：2011-12-06

申请人： Tom Salter ,  Ben Sugden ,  Ben Woodhouse

发明人： Tom Salter ,  Ben Sugden ,  Ben Woodhouse

IPC分类号： G09G5/00 ,  G06K9/00 ,  G06T7/00

CPC分类号： G06K9/00671 ,  G06T7/74 ,  G06T2207/30204

摘要： A system and method executable by a computing device of an augmented reality system for registering a camera in a physical space is provided. The method may include identifying an origin marker in a series of images of a physical space captured by a camera of an augmented reality system, and defining a marker graph having an origin marker node. The method may further include analyzing in real-time the series of images to identify a plurality of expansion markers with locations defined relative to previously imaged markers, and defining corresponding expansion marker nodes in the marker graph. The method may further include calculating a current position of the camera of the augmented reality system in the physical space based on a location of a node in the marker graph corresponding to a most recently imaged marker, relative to the origin marker and any intermediate markers.

摘要翻译： 提供了一种可通过用于在物理空间中登记相机的增强现实系统的计算装置执行的系统和方法。 该方法可以包括识别由增强现实系统的相机捕获的物理空间的一系列图像中的原始标记，并且定义具有原点标记节点的标记图。 该方法还可以包括实时分析一系列图像以识别具有相对于先前成像的标记定义的位置的多个扩展标记，以及在标记图中定义对应的扩展标记节点。 该方法还可以包括基于相对于原始标记和任何中间标记对应于最近成像的标记的标记图中的节点的位置来计算物理空间中的增强现实系统的相机的当前位置。

公开(公告)号：US20160027215A1

公开(公告)日：2016-01-28

申请号：US14688695

申请日：2015-04-16

申请人： Aaron Burns ,  Tom Salter ,  Ben Sugden ,  Jeff Sutherland

发明人： Aaron Burns ,  Tom Salter ,  Ben Sugden ,  Jeff Sutherland

IPC分类号： G06T19/00 ,  G02B27/01 ,  G06T19/20

CPC分类号： G06T19/006 ,  G02B27/0103 ,  G02B27/017 ,  G02B27/0172 ,  G02B2027/0123 ,  G02B2027/014 ,  G02B2027/0174 ,  G02B2027/0178 ,  G06F3/011 ,  G06F3/012 ,  G06F3/013 ,  G06T19/20

摘要： An HMD device renders a virtual reality environment in which areas of the real world are masked out so that real world objects such as computer monitors, doors, people, faces, and the like appear visible to the device user and no holographic or virtual reality content is rendered over the visible objects. The HMD device includes a sensor package to support application of surface reconstruction techniques to dynamically detect edges and surfaces of the real world objects and keep objects visible on the display as the user changes position or head pose or when the real world objects move or their positions are changed. The HMD device can expose controls to enable the user to select which real world objects are visible in the virtual reality environment.

摘要翻译： HMD设备呈现虚拟现实环境，其中真实世界的哪些区域被屏蔽，使得诸如计算机显示器，门，人物，面部等的真实世界对象对于设备用户看起来是可见的，并且没有全息或虚拟现实内容 呈现在可见对象上。 HMD设备包括传感器封装，以支持表面重建技术的应用，以动态地检测真实世界对象的边缘和表面，并且当用户改变位置或头部姿势或当现实世界对象移动或其位置时，使对象在显示器上可见 改变了 HMD设备可以暴露控件以使用户能够选择哪些真实世界对象在虚拟现实环境中是可见的。

公开(公告)号：US20160027214A1

公开(公告)日：2016-01-28

申请号：US14628539

申请日：2015-02-23

申请人： Robert Memmott ,  Ben Sugden ,  Tom Salter

发明人： Robert Memmott ,  Ben Sugden ,  Tom Salter

IPC分类号： G06T19/00 ,  G06F3/0354 ,  G02B27/01

CPC分类号： G06T19/006 ,  G02B27/017 ,  G02B27/0172 ,  G02B2027/0123 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0178 ,  G06F3/012 ,  G06F3/013 ,  G06F3/03543 ,  G06F3/0484 ,  G06F3/0486

摘要： A mixed-reality head mounted display (HMD) device supports a three dimensional (3D) virtual world application with which a real world desktop displayed on a monitor coupled to a personal computer (PC) may interact and share mouse input. A mouse input server executing on the PC tracks mouse movements on the desktop displayed on a monitor. When movement of the mouse takes it beyond the edge of the monitor screen, the mouse input server takes control of the mouse and stops mouse messages from propagating through the PC's system. The mouse input server communicates over a network connection to a mouse input client exposed by the application to inform the client that the mouse has transitioned to operating in the virtual world and passes mouse messages describing movements and control operation such as button presses.

摘要翻译： 混合现实头戴式显示器（HMD）装置支持三维（3D）虚拟世界应用程序，与耦合到个人计算机（PC）的显示器上显示的真实世界桌面可以交互并共享鼠标输入。 在PC上执行的鼠标输入服务器跟踪显示在显示器上的桌面上的鼠标移动。 当鼠标移动超出监视器屏幕的边缘时，鼠标输入服务器控制鼠标并停止鼠标消息传播通过PC的系统。 鼠标输入服务器通过网络连接与由应用程序公开的鼠标输入客户端进行通信，通知客户鼠标已经转换为在虚拟世界中操作，并传递描述运动的鼠标消息和控制操作（如按钮按压）。

公开(公告)号：US20160025981A1

公开(公告)日：2016-01-28

申请号：US14612850

申请日：2015-02-03

申请人： Aaron Burns ,  Ben Sugden ,  Tom Salter

发明人： Aaron Burns ,  Ben Sugden ,  Tom Salter

IPC分类号： G02B27/01 ,  G06F3/01 ,  G02B27/00

CPC分类号： G02B27/0172 ,  G02B27/0093 ,  G02B27/0101 ,  G02B27/017 ,  G02B2027/0123 ,  G02B2027/014 ,  G02B2027/0178 ,  G06F3/011 ,  G06F3/012 ,  G06F3/04815 ,  G09G2320/0261

摘要： An HMD device is configured to check the placement of newly introduced objects in a virtual reality environment such as interactive elements like menus, widgets, and notifications to confirm that the objects are significantly present within the user's field of view. If the intended original placement would locate the object outside the field of view, the HMD device relocates the object so that a portion of the object is viewable at the edge of the HMD display closest to its original placement. Such smart placement of virtual objects enables the user to readily discover new objects when they are introduced into the virtual reality environment, and then interact with the objects within a range of motions and/or head positions that is comfortable to support a more optimal interaction and user experience.

摘要翻译： HMD设备被配置为检查新引入的对象在虚拟现实环境中的放置，诸如诸如菜单，小部件和通知之类的交互元素，以确认对象在用户视野内显着存在。 如果预期的原始位置将物体定位在视野外，则HMD装置重新定位物体，使得物体的一部分在最接近其原始位置的HMD显示器的边缘处可见。 虚拟对象的这种智能放置使得用户能够在被引入到虚拟现实环境中时容易地发现新对象，然后在运动和/或头部位置的范围内与对象交互以支持更优化的交互和 用户体验。

公开(公告)号：US20130194389A1

公开(公告)日：2013-08-01

申请号：US13363244

申请日：2012-01-31

申请人： Ben Vaught ,  Ben Sugden ,  Stephen Latta ,  John Clavin

发明人： Ben Vaught ,  Ben Sugden ,  Stephen Latta ,  John Clavin

IPC分类号： H04N7/18 ,  H04N13/02

CPC分类号： H04N13/344 ,  G02B27/0093 ,  G02B27/017 ,  G02B27/0176 ,  G02B2027/0127 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0178 ,  H04N13/383

摘要： A method for assessing a attentiveness to visual stimuli received through a head-mounted display device. The method employs first and second detectors arranged in the head-mounted display device. An ocular state of the wearer of the head-mounted display device is detected with the first detector while the wearer is receiving a visual stimulus. With the second detector, the visual stimulus received by the wearer is detected. The ocular state is then correlated to the wearer's attentiveness to the visual stimulus.

摘要翻译： 一种用于评估通过头戴式显示装置接收的对视觉刺激的注意力的方法。 该方法采用布置在头戴式显示装置中的第一和第二检测器。 当佩戴者正在接收视觉刺激时，用第一检测器检测头戴式显示装置的佩戴者的眼睛状态。 利用第二检测器，检测佩戴者接受的视觉刺激。 然后眼睛状态与佩戴者对视觉刺激的注意力相关。

公开(公告)号：US20130194164A1

公开(公告)日：2013-08-01

申请号：US13360281

申请日：2012-01-27

申请人： Ben Sugden ,  John Clavin ,  Ben Vaught ,  Stephen Latta ,  Kathryn Stone Perez ,  Daniel McCulloch ,  Jason Scott ,  Wei Zhang ,  Darren Bennett ,  Ryan Hastings ,  Arthur Tomlin ,  Kevin Geisner

发明人： Ben Sugden ,  John Clavin ,  Ben Vaught ,  Stephen Latta ,  Kathryn Stone Perez ,  Daniel McCulloch ,  Jason Scott ,  Wei Zhang ,  Darren Bennett ,  Ryan Hastings ,  Arthur Tomlin ,  Kevin Geisner

IPC分类号： G09G5/00

CPC分类号： G06T19/006 ,  G02B27/01 ,  G02B27/017 ,  G02B27/0172 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0141 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F3/011 ,  G06F3/013 ,  G06F3/017 ,  G06F3/1407 ,  G06F3/167 ,  G06F17/30241 ,  G06T7/12 ,  G06T7/194 ,  G06T7/215

摘要： Embodiments for interacting with an executable virtual object associated with a real object are disclosed. In one example, a method for interacting with an executable virtual object associated with a real object includes receiving sensor input from one or more sensors attached to the portable see-through display device, and obtaining information regarding a location of the user based on the sensor input. The method also includes, if the location includes a real object comprising an associated executable virtual object, then determining an intent of the user to interact with the executable virtual object, and if the intent to interact is determined, then interacting with the executable object.

公开(公告)号：US20120326948A1

公开(公告)日：2012-12-27

申请号：US13166346

申请日：2011-06-22

申请人： ROBERT CROCCO ,  BEN SUGDEN ,  KATIE STONE PEREZ

发明人： ROBERT CROCCO ,  BEN SUGDEN ,  KATIE STONE PEREZ

IPC分类号： G09G5/00 ,  G02B27/01

CPC分类号： G02B5/20 ,  G02B27/0172 ,  G02B2027/0112 ,  G02B2027/0118 ,  G02B2027/0178

摘要： An environmental-light filter removably coupled to an optical see-through head-mounted display (HMD) device is disclosed. The environmental-light filter couples to the HMD device between a display component and a real-world scene. Coupling features are provided to allow the filter to be easily and removably attached to the HMD device when desired by a user. The filter increases the primacy of a provided augmented-reality image with respect to a real-world scene and reduces brightness and power consumption requirements for presenting the augmented-reality image. A plurality of filters of varied light transmissivity may be provided from which to select a desired filter based on environmental lighting conditions and user preference. The light transmissivity of the filter may be about 70% light transmissive to substantially or completely opaque.

摘要翻译： 公开了可移除地耦合到光学透视头戴式显示器（HMD）装置的环境光过滤器。 环境光滤波器在显示组件和现实世界场景之间耦合到HMD设备。 提供耦合特征以使得当用户需要时能够使滤波器容易地并且可拆卸地附接到HMD装置。 过滤器增加了提供的增强现实图像相对于现实世界场景的首要性，并且降低了用于呈现增强现实图像的亮度和功耗要求。 可以提供多种不同透光率的滤光器，以根据环境照明条件和用户偏好选择所需的滤光片。 过滤器的透光率可以是基本上或完全不透明的透光率的约70％。

公开(公告)号：US20110065506A1

公开(公告)日：2011-03-17

申请号：US12559973

申请日：2009-09-15

申请人： Ben Sugden

发明人： Ben Sugden

IPC分类号： A63F13/00 ,  G06T15/00

CPC分类号： G06T15/04 ,  G06T17/00

摘要： A method for sculpting a three-dimensional, graphical environment. The method comprises receiving structure data that structurally defines the graphical environment at a first resolution, and storing composite data based on the structure data received. The composite data includes a first subset defining the graphical environment at the first resolution. The method further comprises exporting section-localized data based on the composite data, the section-localized data defining a section of the graphical environment at least structurally, and receiving refined section-localized data defining a section of the graphical environment at a second resolution finer than the first resolution. The method further comprises augmenting the composite data to include a second subset, which, in combination with the first subset, defines at least the section at the second resolution, according to the refined section-localized data received.

摘要翻译： 一种用于雕刻三维图形环境的方法。 该方法包括接收以第一分辨率结构地定义图形环境的结构数据，并且基于所接收的结构数据来存储复合数据。 复合数据包括在第一分辨率下定义图形环境的第一子集。 该方法还包括基于复合数据导出部分本地化的数据，至少在结构上定义图形环境的一部分的部分本地化数据，以及在第二分辨率更精细的情况下接收定义图形环境的一部分的精化部分局部化数据 比第一个决议。 该方法还包括增加复合数据以包括第二子集，第二子集与第一子集组合，根据所接收的精化部分本地化数据，至少定义第二分辨率的部分。

公开(公告)号：US20160027218A1

公开(公告)日：2016-01-28

申请号：US14723065

申请日：2015-05-27

申请人： Tom Salter ,  Ben Sugden ,  Laura Massey ,  Brian Keane

发明人： Tom Salter ,  Ben Sugden ,  Laura Massey ,  Brian Keane

IPC分类号： G06T19/00 ,  G06F3/16 ,  G06T7/00 ,  G06F3/01 ,  G02B27/01

摘要： A head mounted display (HMD) device operating in a real world physical environment is configured with a sensor package that enables determination of an intersection of a projection of the device user's gaze with a location in a mixed or virtual reality environment. When a projected gaze ray is visibly rendered on other HMD devices (where all the devices are operatively coupled), users of those devices can see what the user is looking at in the environment. In multi-user settings, each HMD device user can see each other's projected gaze rays which can facilitate collaboration in a commonly-shared and experienced mixed or virtual reality environment. The gaze projection can be used much like a finger to point at an object, or to indicate a location on a surface with precision and accuracy.

摘要翻译： 在现实世界物理环境中操作的头戴式显示器（HMD）设备配置有传感器封装，其能够确定设备用户的注视的投影与混合或虚拟现实环境中的位置的交集。 当在其他HMD设备（其中所有设备可操作地耦合）上可见地呈现投影的注视射线时，这些设备的用户可以看到用户在环境中看到什么。 在多用户设置中，每个HMD设备用户可以看到彼此的投射凝视射线，这可以促进共享和经验的混合或虚拟现实环境中的协作。 注视投影可以非常像手指来指向物体，或者以精确和准确的方式指示表面上的位置。

公开(公告)号：US20160027213A1

公开(公告)日：2016-01-28

申请号：US14611447

申请日：2015-02-02

申请人： Aaron Burns ,  Ben Sugden ,  Laura Massey ,  Alexandre Da Veiga ,  Tom Salter ,  Greg Alt

发明人： Aaron Burns ,  Ben Sugden ,  Laura Massey ,  Alexandre Da Veiga ,  Tom Salter ,  Greg Alt

IPC分类号： G06T19/00 ,  G06T7/60 ,  G02B27/01

CPC分类号： G02B27/0172 ,  G02B27/017 ,  G02B2027/0138 ,  G02B2027/0167 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F3/011 ,  G06F3/012 ,  G06F3/04815 ,  G06T7/73 ,  G06T2207/10016 ,  G06T2207/10028 ,  H04N13/204 ,  H04N13/279 ,  H04N2013/0081

摘要： An HMD device is configured to vertically adjust the ground plane of a rendered virtual reality environment that has varying elevations to match the flat real world floor so that the device user can move around to navigate and explore the environment and always be properly located on the virtual ground and not be above it or underneath it. Rather than continuously adjust the virtual reality ground plane, which can introduce cognitive dissonance discomfort to the user, when the user is not engaged in some form of locomotion (e.g., walking), the HMD device establishes a threshold radius around the user within which virtual ground plane adjustment is not performed. The user can make movements within the threshold radius without the HMD device shifting the virtual terrain. When the user moves past the threshold radius, the device will perform an adjustment as needed to match the ground plane of the virtual reality environment to the real world floor.

摘要翻译： HMD设备被配置为垂直地调整具有不同高度的渲染的虚拟现实环境的接地平面以匹配平坦的现实世界楼层，使得设备用户可以移动以导航和探索环境并且始终正确地位于虚拟 地面并不在其上或其下方。 HMD设备不是连续地调整虚拟现实接地平面，当使用者没有从事某种形式的运动（例如，行走）时，这可以引起用户的认知不和谐的不适，虚拟的虚拟现实平面在用户周围建立一个阈值半径 不进行接地面调整。 用户可以在阈值半径内进行移动，而HMD设备不会移动虚拟地形。 当用户移动超过阈值半径时，设备将根据需要进行调整，以将虚拟现实环境的接地平面与真实世界的底层相匹配。