-
公开(公告)号:US20130050070A1
公开(公告)日:2013-02-28
申请号:US13221739
申请日:2011-08-30
申请人: John R. Lewis , Yichen Wei , Robert L. Crocco , Benjamin I. Vaught , Alex Aben-Athar Kipman , Kathryn Stone Perez
发明人: John R. Lewis , Yichen Wei , Robert L. Crocco , Benjamin I. Vaught , Alex Aben-Athar Kipman , Kathryn Stone Perez
CPC分类号: G06F3/013 , A61B3/113 , G02B27/0093 , G02B27/017 , G02B27/2228 , G02B2027/0138 , G02B2027/014 , G02B2027/0187 , G06K9/00604
摘要: The technology provides various embodiments for gaze determination within a see-through, near-eye, mixed reality display device. In some embodiments, the boundaries of a gaze detection coordinate system can be determined from a spatial relationship between a user eye and gaze detection elements such as illuminators and at least one light sensor positioned on a support structure such as an eyeglasses frame. The gaze detection coordinate system allows for determination of a gaze vector from each eye based on data representing glints on the user eye, or a combination of image and glint data. A point of gaze may be determined in a three-dimensional user field of view including real and virtual objects. The spatial relationship between the gaze detection elements and the eye may be checked and may trigger a re-calibration of training data sets if the boundaries of the gaze detection coordinate system have changed.
-
公开(公告)号:US09122053B2
公开(公告)日:2015-09-01
申请号:US13443368
申请日:2012-04-10
申请人: Kevin A. Geisner , Brian J. Mount , Stephen G. Latta , Daniel J. McCulloch , Kyungsuk David Lee , Ben J. Sugden , Jeffrey N. Margolis , Kathryn Stone Perez , Sheridan Martin Small , Mark J. Finocchio , Robert L. Crocco, Jr.
发明人: Kevin A. Geisner , Brian J. Mount , Stephen G. Latta , Daniel J. McCulloch , Kyungsuk David Lee , Ben J. Sugden , Jeffrey N. Margolis , Kathryn Stone Perez , Sheridan Martin Small , Mark J. Finocchio , Robert L. Crocco, Jr.
CPC分类号: G02B27/017 , G02B2027/0127 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G06F3/011 , G06F3/013 , G06F3/165 , G06F3/167 , G06K9/00214 , G06K9/00335 , G06K9/00671 , G06K9/34 , G06T19/006 , H04S7/304 , H04S7/306 , H04S2400/11 , H04S2400/15 , H04S2420/03
摘要: Technology is described for providing realistic occlusion between a virtual object displayed by a head mounted, augmented reality display system and a real object visible to the user's eyes through the display. A spatial occlusion in a user field of view of the display is typically a three dimensional occlusion determined based on a three dimensional space mapping of real and virtual objects. An occlusion interface between a real object and a virtual object can be modeled at a level of detail determined based on criteria such as distance within the field of view, display size or position with respect to a point of gaze. Technology is also described for providing three dimensional audio occlusion based on an occlusion between a real object and a virtual object in the user environment.
摘要翻译: 描述了技术,用于在由头戴式显示器,增强现实显示系统显示的虚拟对象和通过显示器对用户的眼睛可见的真实物体之间提供逼真的遮挡。 显示器的用户视野中的空间遮挡通常是基于实际和虚拟物体的三维空间映射确定的三维遮挡。 可以以基于诸如视场内的距离,相对于凝视点的显示大小或位置的标准确定的细节级别来建模真实对象和虚拟对象之间的遮挡界面。 还描述了用于基于用户环境中的真实对象和虚拟对象之间的遮挡来提供三维音频遮挡的技术。
-
53.
公开(公告)号:US09317971B2
公开(公告)日:2016-04-19
申请号:US13538706
申请日:2012-06-29
申请人: Mathew J. Lamb , Ben J. Sugden , Robert L. Crocco, Jr. , Brian E. Keane , Christopher E. Miles , Kathryn Stone Perez , Laura K. Massey , Alex Aben-Athar Kipman
发明人: Mathew J. Lamb , Ben J. Sugden , Robert L. Crocco, Jr. , Brian E. Keane , Christopher E. Miles , Kathryn Stone Perez , Laura K. Massey , Alex Aben-Athar Kipman
CPC分类号: G06T19/006 , G02B27/0172 , G02B2027/014 , G02B2027/0174 , G06F3/013 , G06F3/017 , G06F3/1431 , G09G3/003 , G09G2370/022 , G09G2380/14 , H04N2213/008
摘要: A system for allowing a virtual object to interact with other virtual objects across different spaces within an augmented reality (AR) environment and to transition between the different spaces is described. An AR environment may include a plurality of spaces, each comprising a bounded area or volume within the AR environment. In one example, an AR environment may be associated with a three-dimensional world space and a two-dimensional object space corresponding with a page of a book within the AR environment. A virtual object within the AR environment may be assigned to the object space and transition from the two-dimensional object space to the three-dimensional world space upon the detection of a space transition event. In some cases, a dual representation of the virtual object may be used to detect interactions between the virtual object and other virtual objects in both the world space and the object space.
摘要翻译: 描述了允许虚拟对象在扩充现实(AR)环境内的不同空间之间与其他虚拟对象交互并在不同空间之间转换的系统。 AR环境可以包括多个空间,每个空间包括AR环境内的有界区域或卷。 在一个示例中,AR环境可以与三维世界空间和对应于AR环境中的书页的二维对象空间相关联。 AR环境中的虚拟对象可以被分配给对象空间,并且在检测到空间转换事件时从二维对象空间转换到三维世界空间。 在某些情况下,可以使用虚拟对象的双重表示来检测虚拟对象与世界空间和对象空间中的其他虚拟对象之间的交互。
-
公开(公告)号:US20140002495A1
公开(公告)日:2014-01-02
申请号:US13538829
申请日:2012-06-29
申请人: Mathew J. Lamb , Ben J. Sugden , Robert L. Crocco, JR. , Brian E. Keane , Christopher E. Miles , Kathryn Stone Perez , Laura K. Massey , Alex Aben-Athar Kipman
发明人: Mathew J. Lamb , Ben J. Sugden , Robert L. Crocco, JR. , Brian E. Keane , Christopher E. Miles , Kathryn Stone Perez , Laura K. Massey , Alex Aben-Athar Kipman
IPC分类号: G09G5/00
CPC分类号: G09G3/003 , G02B27/017 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G06F3/1431 , G09G2370/022 , H04N2201/3245 , H04N2201/3269
摘要: A system for identifying an AR tag and determining a location for a virtual object within an augmented reality environment corresponding with the AR tag is described. In some environments, including those with viewing obstructions, the identity of the AR tag and the location of a corresponding virtual object may be determined by aggregating individual identity and location determinations from a plurality of head-mounted display devices (HMDs). The virtual object may comprise a shared virtual object that is viewable from each of the plurality of HMDs as existing at a shared location within the augmented reality environment. The shared location may comprise a weighted average of individual location determinations from each of the plurality of HMDs. By aggregating and analyzing individual identity and location determinations, a particular HMD of the plurality of HMDs may display a virtual object without having to identify a corresponding AR tag directly.
摘要翻译: 描述用于识别AR标签并确定与AR标签相对应的增强现实环境中的虚拟对象的位置的系统。 在一些环境中,包括具有观察障碍物的环境中,AR标签的身份和相应的虚拟对象的位置可以通过从多个头戴式显示设备(HMD)聚合个体身份和位置确定来确定。 虚拟对象可以包括可从多个HMD中的每一个查看的共享虚拟对象,其存在于增强现实环境中的共享位置处。 共享位置可以包括来自多个HMD中的每一个的各个位置确定的加权平均。 通过聚合和分析个体身份和位置确定,多个HMD中的特定HMD可以显示虚拟对象,而不必直接识别对应的AR标签。
-
55.
公开(公告)号:US20140002492A1
公开(公告)日:2014-01-02
申请号:US13538691
申请日:2012-06-29
申请人: Mathew J. Lamb , Ben J. Sugden , Robert L. Crocco, JR. , Brian E. Keane , Christopher E. Miles , Kathryn Stone Perez , Laura K. Massey , Alex Aben-Athar Kipman , Tom G. Salter
发明人: Mathew J. Lamb , Ben J. Sugden , Robert L. Crocco, JR. , Brian E. Keane , Christopher E. Miles , Kathryn Stone Perez , Laura K. Massey , Alex Aben-Athar Kipman , Tom G. Salter
IPC分类号: G09G5/00
CPC分类号: G06F3/013 , G02B27/017 , G02B2027/014 , G06F1/163 , G06F3/011 , G06F3/012 , G06F3/0304
摘要: Techniques are provided for propagating real world properties into mixed reality images in a see-through, near-eye mixed reality display device. A physical property from the real world may be propagated into a virtual image to be rendered in the display device. Thus, the physics depicted in the mixed reality images may be influenced by a physical property in the environment. Therefore, the user wearing the mixed reality display device is provided a better sense that it is mixed reality, as opposed to simply virtual reality. The mixed reality image may be linked to a real world physical object. This physical object can be movable such as a book, paper, cellular telephone, etc. Forces on the physical object may be propagated into the virtual image.
摘要翻译: 提供了一种技术,用于将真实世界的属性传播到透视,近眼混合现实显示设备中的混合现实图像中。 来自真实世界的物理属性可以被传播到在显示设备中呈现的虚拟图像中。 因此,混合现实图像中描绘的物理学可能受到环境中物理性质的影响。 因此,与简单的虚拟现实相反,佩戴混合现实显示装置的用户被提供更好的感觉,它是混合的现实。 混合的现实图像可能与真实世界的物理对象相关联。 该物理物体可以是可移动的,例如书籍,纸张,蜂窝电话等。物理对象上的力可以传播到虚拟图像中。
-
公开(公告)号:US20140002491A1
公开(公告)日:2014-01-02
申请号:US13538683
申请日:2012-06-29
申请人: Mathew J. Lamb , Ben J. Sugden , Robert L. Crocco, JR. , Brian E. Keane , Christopher E. Miles , Kathryn Stone Perez , Laura K. Massey , Alex Aben-Athar Kipman , Jeffrey Neil Margolis
发明人: Mathew J. Lamb , Ben J. Sugden , Robert L. Crocco, JR. , Brian E. Keane , Christopher E. Miles , Kathryn Stone Perez , Laura K. Massey , Alex Aben-Athar Kipman , Jeffrey Neil Margolis
IPC分类号: G09G5/00
CPC分类号: G06F3/011 , G02B27/017 , G02B2027/014 , G02B2027/0141 , G02B2027/0178 , G02B2027/0187 , G06F1/163 , G06F3/012 , G06F3/013 , G06F3/0304
摘要: Techniques are provided for rendering, in a see-through, near-eye mixed reality display, a virtual object within a virtual hole, window or cutout. The virtual hole, window or cutout may appear to be within some real world physical object such as a book, table, etc. The virtual object may appear to be just below the surface of the physical object. In a sense, the virtual world could be considered to be a virtual container that provides developers with additional locations for presenting virtual objects. For example, rather than rendering a virtual object, such as a lamp, in a mixed reality display such that appears to sit on top of a real world desk, the virtual object is rendered such that it appears to be located below the surface of the desk.
摘要翻译: 提供了技术,用于在透视,近眼混合现实显示,虚拟孔,窗口或切口内的虚拟对象中渲染。 虚拟孔,窗口或切口可能看起来像一些真实世界的物体,如书,桌等。虚拟对象可能看起来就在物理对象的表面之下。 在某种意义上,虚拟世界可以被认为是一个虚拟容器,为开发人员提供了用于呈现虚拟对象的更多位置。 例如,虚拟对象不是将虚拟对象(例如灯)呈现在混合现实显示器中,使得它似乎位于真实世界桌面之上,使得虚拟物体看起来位于 台。
-
57.
公开(公告)号:US20140002442A1
公开(公告)日:2014-01-02
申请号:US13538706
申请日:2012-06-29
申请人: Mathew J. Lamb , Ben J. Sugden , Robert L. Crocco, JR. , Brian E. Keane , Christopher E. Miles , Kathryn Stone Perez , Laura K. Massey , Alex Aben-Athar Kipman
发明人: Mathew J. Lamb , Ben J. Sugden , Robert L. Crocco, JR. , Brian E. Keane , Christopher E. Miles , Kathryn Stone Perez , Laura K. Massey , Alex Aben-Athar Kipman
CPC分类号: G06T19/006 , G02B27/0172 , G02B2027/014 , G02B2027/0174 , G06F3/013 , G06F3/017 , G06F3/1431 , G09G3/003 , G09G2370/022 , G09G2380/14 , H04N2213/008
摘要: A system for allowing a virtual object to interact with other virtual objects across different spaces within an augmented reality (AR) environment and to transition between the different spaces is described. An AR environment may include a plurality of spaces, each comprising a bounded area or volume within the AR environment. In one example, an AR environment may be associated with a three-dimensional world space and a two-dimensional object space corresponding with a page of a book within the AR environment. A virtual object within the AR environment may be assigned to the object space and transition from the two-dimensional object space to the three-dimensional world space upon the detection of a space transition event. In some cases, a dual representation of the virtual object may be used to detect interactions between the virtual object and other virtual objects in both the world space and the object space.
摘要翻译: 描述了允许虚拟对象在扩充现实(AR)环境内的不同空间之间与其他虚拟对象交互并在不同空间之间转换的系统。 AR环境可以包括多个空间,每个空间包括AR环境内的有界区域或卷。 在一个示例中,AR环境可以与三维世界空间和对应于AR环境中的书页的二维对象空间相关联。 AR环境中的虚拟对象可以被分配给对象空间,并且在检测到空间转换事件时从二维对象空间转换到三维世界空间。 在某些情况下,可以使用虚拟对象的双重表示来检测虚拟对象与世界空间和对象空间中的其他虚拟对象之间的交互。
-
公开(公告)号:US20130307856A1
公开(公告)日:2013-11-21
申请号:US13473268
申请日:2012-05-16
申请人: Brian E. Keane , Ben J. Sugden , Robert L. Crocco, JR. , Christopher E. Miles , Kathryn Stone Perez , Laura K. Massey , Mathew J. Lamb , Alex Aben-Athar Kipman
发明人: Brian E. Keane , Ben J. Sugden , Robert L. Crocco, JR. , Christopher E. Miles , Kathryn Stone Perez , Laura K. Massey , Mathew J. Lamb , Alex Aben-Athar Kipman
IPC分类号: G06T13/00
CPC分类号: G06F3/0483 , G03H1/2294 , G03H2001/2284 , G03H2227/02 , G03H2270/55 , G06F3/011 , G06F3/1415 , G06T19/006 , G09B5/062 , G10L15/26 , G10L21/10 , G10L25/03 , G10L2021/105
摘要: A system for generating and displaying holographic visual aids associated with a story to an end user of a head-mounted display device while the end user is reading the story or perceiving the story being read aloud is described. The story may be embodied within a reading object (e.g., a book) in which words of the story may be displayed to the end user. The holographic visual aids may include a predefined character animation that is synchronized to a portion of the story corresponding with the character being animated. A reading pace of a portion of the story may be used to control the playback speed of the predefined character animation in real-time such that the character is perceived to be lip-syncing the story being read aloud. In some cases, an existing book without predetermined AR tags may be augmented with holographic visual aids.
-
公开(公告)号:US20120206452A1
公开(公告)日:2012-08-16
申请号:US13443368
申请日:2012-04-10
申请人: Kevin A. Geisner , Brian J. Mount , Stephen G. Latta , Daniel J. McCulloch , Kyungsuk David Lee , Ben J. Sugden , Jeffrey N. Margolis , Kathryn Stone Perez , Sheridan Martin Small , Mark J. Finocchio , Robert L. Crocco, JR.
发明人: Kevin A. Geisner , Brian J. Mount , Stephen G. Latta , Daniel J. McCulloch , Kyungsuk David Lee , Ben J. Sugden , Jeffrey N. Margolis , Kathryn Stone Perez , Sheridan Martin Small , Mark J. Finocchio , Robert L. Crocco, JR.
CPC分类号: G02B27/017 , G02B2027/0127 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G06F3/011 , G06F3/013 , G06F3/165 , G06F3/167 , G06K9/00214 , G06K9/00335 , G06K9/00671 , G06K9/34 , G06T19/006 , H04S7/304 , H04S7/306 , H04S2400/11 , H04S2400/15 , H04S2420/03
摘要: Technology is described for providing realistic occlusion between a virtual object displayed by a head mounted, augmented reality display system and a real object visible to the user's eyes through the display. A spatial occlusion in a user field of view of the display is typically a three dimensional occlusion determined based on a three dimensional space mapping of real and virtual objects. An occlusion interface between a real object and a virtual object can be modeled at a level of detail determined based on criteria such as distance within the field of view, display size or position with respect to a point of gaze. Technology is also described for providing three dimensional audio occlusion based on an occlusion between a real object and a virtual object in the user environment.
摘要翻译: 描述了技术,用于在由头戴式显示器,增强现实显示系统显示的虚拟对象和通过显示器对用户的眼睛可见的真实物体之间提供逼真的遮挡。 显示器的用户视野中的空间遮挡通常是基于实际和虚拟物体的三维空间映射确定的三维遮挡。 可以以基于诸如视场内的距离,相对于凝视点的显示大小或位置的标准确定的细节级别来建模真实对象和虚拟对象之间的遮挡界面。 还描述了用于基于用户环境中的真实对象和虚拟对象之间的遮挡来提供三维音频遮挡的技术。
-
公开(公告)号:US08602887B2
公开(公告)日:2013-12-10
申请号:US12792961
申请日:2010-06-03
IPC分类号: G06F17/00
CPC分类号: A63F13/63 , A63F13/213 , A63F13/215 , A63F2300/1018 , A63F2300/1087 , A63F2300/6072 , A63F2300/6081
摘要: A system and method are disclosed for synthesizing information received from multiple audio and visual sources focused on a single scene. The system may determine the positions of capture devices based on a common set of cues identified in the image data of the capture devices. As a scene may often have users and objects moving into and out of the scene, data from the multiple capture devices may be time synchronized to ensure that data from the audio and visual sources are providing data of the same scene at the same time. Audio and/or visual data from the multiple sources may be reconciled and assimilated together to improve an ability of the system to interpret audio and/or visual aspects from the scene.
摘要翻译: 公开了一种用于合成从聚焦在单个场景上的多个音频和视频源接收的信息的系统和方法。 系统可以基于在捕获设备的图像数据中识别的一组公共信号来确定捕获设备的位置。 由于场景通常可能使用户和对象进出场景,来自多个捕获设备的数据可能是时间同步的,以确保来自音频和视频源的数据同时提供相同场景的数据。 来自多个源的音频和/或视觉数据可以一起协调和同化,以提高系统从场景中解释音频和/或视觉方面的能力。
-
-
-
-
-
-
-
-
-