公开(公告)号：US20130307856A1

公开(公告)日：2013-11-21

申请号：US13473268

申请日：2012-05-16

申请人： Brian E. Keane ,  Ben J. Sugden ,  Robert L. Crocco, JR. ,  Christopher E. Miles ,  Kathryn Stone Perez ,  Laura K. Massey ,  Mathew J. Lamb ,  Alex Aben-Athar Kipman

发明人： Brian E. Keane ,  Ben J. Sugden ,  Robert L. Crocco, JR. ,  Christopher E. Miles ,  Kathryn Stone Perez ,  Laura K. Massey ,  Mathew J. Lamb ,  Alex Aben-Athar Kipman

IPC分类号： G06T13/00

CPC分类号： G06F3/0483 ,  G03H1/2294 ,  G03H2001/2284 ,  G03H2227/02 ,  G03H2270/55 ,  G06F3/011 ,  G06F3/1415 ,  G06T19/006 ,  G09B5/062 ,  G10L15/26 ,  G10L21/10 ,  G10L25/03 ,  G10L2021/105

摘要： A system for generating and displaying holographic visual aids associated with a story to an end user of a head-mounted display device while the end user is reading the story or perceiving the story being read aloud is described. The story may be embodied within a reading object (e.g., a book) in which words of the story may be displayed to the end user. The holographic visual aids may include a predefined character animation that is synchronized to a portion of the story corresponding with the character being animated. A reading pace of a portion of the story may be used to control the playback speed of the predefined character animation in real-time such that the character is perceived to be lip-syncing the story being read aloud. In some cases, an existing book without predetermined AR tags may be augmented with holographic visual aids.

公开(公告)号：US20130083173A1

公开(公告)日：2013-04-04

申请号：US13538923

申请日：2012-06-29

申请人： Kevin A. Geisner ,  Kathryn Stone Perez ,  Stephen G. Latta ,  Ben J. Sugden ,  Benjamin I. Vaught ,  Alex Aben-Athar Kipman ,  Michael J. Scavezze ,  Daniel J. McCulloch ,  Darren Bennett ,  Jason Scott ,  Ryan L. Hastings ,  Brian E. Keane ,  Christopher E. Miles ,  Robert L. Crocco, JR. ,  Mathew J. Lamb

发明人： Kevin A. Geisner ,  Kathryn Stone Perez ,  Stephen G. Latta ,  Ben J. Sugden ,  Benjamin I. Vaught ,  Alex Aben-Athar Kipman ,  Michael J. Scavezze ,  Daniel J. McCulloch ,  Darren Bennett ,  Jason Scott ,  Ryan L. Hastings ,  Brian E. Keane ,  Christopher E. Miles ,  Robert L. Crocco, JR. ,  Mathew J. Lamb

IPC分类号： H04N7/18 ,  H04N13/04

CPC分类号： G06F3/017 ,  G02B27/017 ,  G02B2027/014 ,  G02B2027/0178 ,  G06F3/013 ,  G06F3/1423 ,  G06T19/006 ,  G09G3/003 ,  G09G2354/00 ,  H04N7/181 ,  H04N13/194 ,  H04N13/239 ,  H04N13/344 ,  H04N13/366 ,  H04N21/2143 ,  H04N21/2187 ,  H04N21/23418 ,  H04N21/41407 ,  H04N21/8146 ,  H04N21/816

摘要： Technology is described for providing a virtual spectator experience for a user of a personal A/V apparatus including a near-eye, augmented reality (AR) display. A position volume of an event object participating in an event in a first 3D coordinate system for a first location is received and mapped to a second position volume in a second 3D coordinate system at a second location remote from where the event is occurring. A display field of view of the near-eye AR display at the second location is determined, and real-time 3D virtual data representing the one or more event objects which are positioned within the display field of view are displayed in the near-eye AR display. A user may select a viewing position from which to view the event. Additionally, virtual data of a second user may be displayed at a position relative to a first user.

摘要翻译： 技术被描述为为包括近眼，增强现实（AR）显示器的个人A / V设备的用户提供虚拟观众体验。 参与第一个3D坐标系统中第一个位置的事件的事件对象的位置音量被接收并映射到远离事件发生的第二个位置的第二个3D坐标系中的第二个位置卷。 确定第二位置处的近眼AR显示的显示视野，并且将表示位于显示视野内的一个或多个事件对象的实时3D虚拟数据显示在近眼睛AR中 显示。 用户可以选择查看事件的观看位置。 此外，可以在相对于第一用户的位置处显示第二用户的虚拟数据。

公开(公告)号：US20140152558A1

公开(公告)日：2014-06-05

申请号：US13691445

申请日：2012-11-30

申请人： Tom Salter ,  Ben J. Sugden ,  Daniel Deptford ,  Robert L. Crocco, JR. ,  Brian E. Keane ,  Christopher E. Miles ,  Laura K. Massey ,  Alex Aben-Athar Kipman

发明人： Tom Salter ,  Ben J. Sugden ,  Daniel Deptford ,  Robert L. Crocco, JR. ,  Brian E. Keane ,  Christopher E. Miles ,  Laura K. Massey ,  Alex Aben-Athar Kipman

IPC分类号： G09G5/377 ,  G06F3/033

CPC分类号： G09G5/377 ,  G02B27/017 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F3/013 ,  G06F3/0346

摘要： Methods for controlling an augmented reality environment associated with a head-mounted display device (HMD) are described. In some embodiments, a virtual pointer may be displayed to an end user of the HMD and controlled by the end user using motion and/or orientation information associated with a secondary device (e.g., a mobile phone). Using the virtual pointer, the end user may select and manipulate virtual objects within the augmented reality environment, select real-world objects within the augmented reality environment, and/or control a graphical user interface of the HMD. In some cases, the initial position of the virtual pointer within the augmented reality environment may be determined based on a particular direction in which the end user is gazing and/or a particular object at which the end user is currently focusing on or has recently focused on.

摘要翻译： 描述了用于控制与头戴式显示装置（HMD）相关联的增强现实环境的方法。 在一些实施例中，可以向HMD的最终用户显示虚拟指针，并且由最终用户使用与辅助设备（例如，移动电话）相关联的运动和/或定向信息进行控制。 使用虚拟指针，最终用户可以选择和操纵增强现实环境中的虚拟对象，选择增强现实环境中的真实世界对象，和/或控制HMD的图形用户界面。 在一些情况下，虚拟指针在增强现实环境中的初始位置可以基于最终用户注视的特定方向和/或最终用户当前聚焦于或最近聚焦的特定对象来确定 上。

公开(公告)号：US20140368532A1

公开(公告)日：2014-12-18

申请号：US13921053

申请日：2013-06-18

申请人： Brian E. Keane ,  Ben J. Sugden ,  Robert L. Crocco, JR. ,  Daniel Deptford ,  Tom G. Salter ,  Laura K. Massey ,  Alex Aben-Athar Kipman ,  Peter Tobias Kinnebrew ,  Nicholas Ferianc Kamuda

发明人： Brian E. Keane ,  Ben J. Sugden ,  Robert L. Crocco, JR. ,  Daniel Deptford ,  Tom G. Salter ,  Laura K. Massey ,  Alex Aben-Athar Kipman ,  Peter Tobias Kinnebrew ,  Nicholas Ferianc Kamuda

IPC分类号： G02B27/01

CPC分类号： G02B27/017 ,  G06F3/012 ,  G06F3/04815 ,  G06T19/006

摘要： A method and apparatus for the creation of a perspective-locked virtual object having in world space. The virtual object may be consumed) by another user with a consumption device at a location, position, and orientation which is the same as, or proximate to, the location, position, and orientation where the virtual object is created. Objects may have one, few or many allowable consumption locations, positions, and orientations defined by its creator

摘要翻译： 一种用于创建具有世界空间的透视锁定虚拟对象的方法和装置。 虚拟对象可以被消费设备的消费设备所占据的位置，位置和方向消耗，该位置，位置和方向与创建虚拟对象的位置，位置和方向相同或接近。 对象可能具有一个，几个或许多允许的消费位置，位置和由其创建者定义的方向

公开(公告)号：US20140368534A1

公开(公告)日：2014-12-18

申请号：US13921113

申请日：2013-06-18

申请人： Tom G. Salter ,  Ben J. Sugden ,  Daniel Deptford ,  Robert L. Crocco, JR. ,  Brian E. Keane ,  Laura K. Massey ,  Alex Aben-Athar Kipman ,  Peter Tobias Kinnebrew ,  Nicholas Ferianc Kamuda

发明人： Tom G. Salter ,  Ben J. Sugden ,  Daniel Deptford ,  Robert L. Crocco, JR. ,  Brian E. Keane ,  Laura K. Massey ,  Alex Aben-Athar Kipman ,  Peter Tobias Kinnebrew ,  Nicholas Ferianc Kamuda

IPC分类号： G02B27/01

CPC分类号： G02B27/017 ,  G06F3/011 ,  G06F3/012 ,  G06F3/017 ,  G06T19/006 ,  G06T2215/16 ,  G06T2219/024 ,  G09G2354/00

摘要： A see through head mounted display apparatus includes code performing a method of choosing and optimal viewing location and perspective for shared-view virtual objects rendered for multiple users in a common environment. Multiple objects and multiple users are taken into account in determining the optimal, common viewing location. The technology allows each user to have a common view if the relative position of the object in the environment.

摘要翻译： 透视头戴式显示装置包括执行在公共环境中为多个用户呈现的共享视图虚拟对象选择和优化观看位置和透视图的代码的代码。 在确定最佳的常见观看位置时，会考虑多个对象和多个用户。 如果对象在环境中的相对位置，则该技术允许每个用户具有共同的视图。

公开(公告)号：US20140347391A1

公开(公告)日：2014-11-27

申请号：US13901342

申请日：2013-05-23

申请人： Brian E. Keane ,  Ben J. Sugden ,  Robert L. Crocco, JR. ,  Daniel Deptford ,  Tom G. Salter ,  Laura K. Massey ,  Alex Aben-Athar Kipman ,  Peter Tobias Kinnebrew ,  Nicholas Ferianc Kamuda

发明人： Brian E. Keane ,  Ben J. Sugden ,  Robert L. Crocco, JR. ,  Daniel Deptford ,  Tom G. Salter ,  Laura K. Massey ,  Alex Aben-Athar Kipman ,  Peter Tobias Kinnebrew ,  Nicholas Ferianc Kamuda

IPC分类号： G06T19/00

CPC分类号： G06T19/006 ,  G06F3/011 ,  G06F3/04815 ,  G06F3/0487

摘要： A system and method are disclosed for displaying virtual objects in a mixed reality environment in a way that is optimal and most comfortable for a user to interact with the virtual objects. When a user is moving through the mixed reality environment, the virtual objects may remain world-locked, so that the user can move around and explore the virtual objects from different perspectives. When the user is motionless in the mixed reality environment, the virtual objects may rotate to face the user so that the user can easily view and interact with the virtual objects.

摘要翻译： 公开了一种系统和方法，用于以混合现实环境中的虚拟对象以对于用户与虚拟对象交互是最佳和最舒适的方式来显示虚拟对象。 当用户移动通过混合现实环境时，虚拟对象可能保持世界锁定，从而用户可以从不同的角度移动并探索虚拟对象。 当用户在混合现实环境中静止时，虚拟对象可以旋转以面对用户，使得用户可以容易地查看虚拟对象并与虚拟对象交互。

公开(公告)号：US20140368535A1

公开(公告)日：2014-12-18

申请号：US13921116

申请日：2013-06-18

申请人： Tom G. Salter ,  Ben J. Sugden ,  Daniel Deptford ,  Robert L. Crocco, JR. ,  Brian E. Keane ,  Laura K. Massey ,  Alex Aben-Athar Kipman ,  Peter Tobias Kinnebrew ,  Nicholas Ferianc Kamuda

发明人： Tom G. Salter ,  Ben J. Sugden ,  Daniel Deptford ,  Robert L. Crocco, JR. ,  Brian E. Keane ,  Laura K. Massey ,  Alex Aben-Athar Kipman ,  Peter Tobias Kinnebrew ,  Nicholas Ferianc Kamuda

IPC分类号： G02B27/01

CPC分类号： G02B27/017 ,  G02B2027/014 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F3/011 ,  G06F3/012 ,  G06T11/60 ,  G06T19/006

摘要： A system and method are disclosed for displaying virtual objects in a mixed reality environment in a way that is optimal and most comfortable for a user to interact with the virtual objects. When a user is not focused on the virtual object, which may be a heads-up display, or HUD, the HUD may remain body locked to the user. As such, the user may explore and interact with a mixed reality environment presented by the head mounted display device without interference from the HUD. When a user wishes to view and/or interact with the HUD, the user may look at the HUD. At this point, the HUD may change from a body locked virtual object to a world locked virtual object. The user is then able to view and interact with the HUD from different positions and perspectives of the HUD.

摘要翻译： 公开了一种系统和方法，用于以混合现实环境中的虚拟对象以对于用户与虚拟对象交互是最佳和最舒适的方式来显示虚拟对象。 当用户不专注于可以是平视显示器或HUD的虚拟对象时，HUD可以保持对用户的身体锁定。 因此，用户可以探索并与头戴式显示设备呈现的混合现实环境交互，而不会受到HUD的干扰。 当用户希望查看和/或与HUD进行交互时，用户可以观察HUD。 在这一点上，HUD可以从身体锁定的虚拟对象改变为世界锁定的虚拟对象。 然后，用户可以从HUD的不同位置和角度查看和与HUD进行交互。

公开(公告)号：US20140368537A1

公开(公告)日：2014-12-18

申请号：US13921122

申请日：2013-06-18

申请人： Tom G. Salter ,  Ben J. Sugden ,  Daniel Deptford ,  Robert L. Crocco, JR. ,  Brian E. Keane ,  Laura K. Massey ,  Alex Aben-Athar Kipman ,  Peter Tobias Kinnebrew ,  Nicholas Ferianc Kamuda

发明人： Tom G. Salter ,  Ben J. Sugden ,  Daniel Deptford ,  Robert L. Crocco, JR. ,  Brian E. Keane ,  Laura K. Massey ,  Alex Aben-Athar Kipman ,  Peter Tobias Kinnebrew ,  Nicholas Ferianc Kamuda

IPC分类号： G06T19/00

CPC分类号： G06T19/006 ,  G02B27/017 ,  G02B2027/014 ,  G06F3/011

摘要： A system and method are disclosed for displaying virtual objects in a mixed reality environment including shared virtual objects and private virtual objects. Multiple users can collaborate together in interacting with the shared virtual objects. A private virtual object may be visible to a single user. In examples, private virtual objects of respective users may facilitate the users' collaborative interaction with one or more shared virtual objects.

摘要翻译： 公开了一种用于在包括共享虚拟对象和私有虚拟对象的混合现实环境中显示虚拟对象的系统和方法。 多个用户可以协同工作，与共享的虚拟对象进行交互。 私人虚拟对象可能对单个用户可见。 在示例中，各个用户的私有虚拟对象可以促进用户与一个或多个共享虚拟对象的协作交互。

公开(公告)号：US20120206452A1

公开(公告)日：2012-08-16

申请号：US13443368

申请日：2012-04-10

申请人： Kevin A. Geisner ,  Brian J. Mount ,  Stephen G. Latta ,  Daniel J. McCulloch ,  Kyungsuk David Lee ,  Ben J. Sugden ,  Jeffrey N. Margolis ,  Kathryn Stone Perez ,  Sheridan Martin Small ,  Mark J. Finocchio ,  Robert L. Crocco, JR.

发明人： Kevin A. Geisner ,  Brian J. Mount ,  Stephen G. Latta ,  Daniel J. McCulloch ,  Kyungsuk David Lee ,  Ben J. Sugden ,  Jeffrey N. Margolis ,  Kathryn Stone Perez ,  Sheridan Martin Small ,  Mark J. Finocchio ,  Robert L. Crocco, JR.

IPC分类号： G06T15/00 ,  G09G5/00

CPC分类号： G02B27/017 ,  G02B2027/0127 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0178 ,  G06F3/011 ,  G06F3/013 ,  G06F3/165 ,  G06F3/167 ,  G06K9/00214 ,  G06K9/00335 ,  G06K9/00671 ,  G06K9/34 ,  G06T19/006 ,  H04S7/304 ,  H04S7/306 ,  H04S2400/11 ,  H04S2400/15 ,  H04S2420/03

摘要： Technology is described for providing realistic occlusion between a virtual object displayed by a head mounted, augmented reality display system and a real object visible to the user's eyes through the display. A spatial occlusion in a user field of view of the display is typically a three dimensional occlusion determined based on a three dimensional space mapping of real and virtual objects. An occlusion interface between a real object and a virtual object can be modeled at a level of detail determined based on criteria such as distance within the field of view, display size or position with respect to a point of gaze. Technology is also described for providing three dimensional audio occlusion based on an occlusion between a real object and a virtual object in the user environment.

摘要翻译： 描述了技术，用于在由头戴式显示器，增强现实显示系统显示的虚拟对象和通过显示器对用户的眼睛可见的真实物体之间提供逼真的遮挡。 显示器的用户视野中的空间遮挡通常是基于实际和虚拟物体的三维空间映射确定的三维遮挡。 可以以基于诸如视场内的距离，相对于凝视点的显示大小或位置的标准确定的细节级别来建模真实对象和虚拟对象之间的遮挡界面。 还描述了用于基于用户环境中的真实对象和虚拟对象之间的遮挡来提供三维音频遮挡的技术。

公开(公告)号：US20110316853A1

公开(公告)日：2011-12-29

申请号：US12821249

申请日：2010-06-23

申请人： Avi Bar-Zeev ,  Christian F. Huitema ,  Alex Aben-Athar Kipman ,  Robert L. Crocco, JR. ,  John Allen Tardif ,  Eric G. Lang

发明人： Avi Bar-Zeev ,  Christian F. Huitema ,  Alex Aben-Athar Kipman ,  Robert L. Crocco, JR. ,  John Allen Tardif ,  Eric G. Lang

IPC分类号： G06T17/00 ,  G09G5/08

CPC分类号： G06T15/20 ,  G06F3/1454 ,  G09G2354/00 ,  H04N7/144

摘要： Described herein is a telepresence system where a real-time a virtual hologram of a user is displayed at a remote display screen and is rendered from a vantage point that is different than the vantage point from which images of the user are captured via a video camera. The virtual hologram is based at least in part upon data acquired from a sensor unit at the location of the user. The sensor unit includes a color video camera that captures 2-D images of the user including surface features of the user. The sensor unit also includes a depth sensor that captures 3-D geometry data indicative of the relative position of surfaces on the user in 3-D space. The virtual hologram is rendered to orientate the gaze of the eyes of the virtual hologram towards the eyes of a second user viewing the remote display screen.

摘要翻译： 这里描述了一种远程呈现系统，其中实时的用户的虚拟全息图被显示在远程显示屏幕处，并且是从与用户的图像经由摄像机捕获的有利位置不同的有利点呈现的 。 虚拟全息图至少部分地基于从用户位置处的传感器单元获取的数据。 传感器单元包括彩色摄像机，其捕获用户的2D图像，包括用户的表面特征。 传感器单元还包括深度传感器，其捕获指示用户在3D空间中的表面的相对位置的三维几何数据。 渲染虚拟全息图以将虚拟全息图的眼睛的视线朝向观看远程显示屏幕的第二用户的眼睛定向。