-
51.
公开(公告)号:US09268406B2
公开(公告)日:2016-02-23
申请号:US13538923
申请日:2012-06-29
申请人: Kevin A. Geisner , Kathryn Stone Perez , Stephen G. Latta , Ben J. Sugden , Benjamin I. Vaught , Alex Aben-Athar Kipman , Michael J. Scavezze , Daniel J. McCulloch , Darren Bennett , Jason Scott , Ryan L. Hastings , Brian E. Keane , Christopher E. Miles , Robert L. Crocco, Jr. , Mathew J. Lamb
发明人: Kevin A. Geisner , Kathryn Stone Perez , Stephen G. Latta , Ben J. Sugden , Benjamin I. Vaught , Alex Aben-Athar Kipman , Michael J. Scavezze , Daniel J. McCulloch , Darren Bennett , Jason Scott , Ryan L. Hastings , Brian E. Keane , Christopher E. Miles , Robert L. Crocco, Jr. , Mathew J. Lamb
IPC分类号: G09G5/377 , G06F3/01 , H04N13/02 , H04N13/04 , G02B27/01 , G06T19/00 , H04N13/00 , H04N7/18 , H04N21/214 , H04N21/2187 , H04N21/234 , H04N21/414 , H04N21/81
CPC分类号: G06F3/017 , G02B27/017 , G02B2027/014 , G02B2027/0178 , G06F3/013 , G06F3/1423 , G06T19/006 , G09G3/003 , G09G2354/00 , H04N7/181 , H04N13/194 , H04N13/239 , H04N13/344 , H04N13/366 , H04N21/2143 , H04N21/2187 , H04N21/23418 , H04N21/41407 , H04N21/8146 , H04N21/816
摘要: Technology is described for providing a virtual spectator experience for a user of a personal A/V apparatus including a near-eye, augmented reality (AR) display. A position volume of an event object participating in an event in a first 3D coordinate system for a first location is received and mapped to a second position volume in a second 3D coordinate system at a second location remote from where the event is occurring. A display field of view of the near-eye AR display at the second location is determined, and real-time 3D virtual data representing the one or more event objects which are positioned within the display field of view are displayed in the near-eye AR display. A user may select a viewing position from which to view the event. Additionally, virtual data of a second user may be displayed at a position relative to a first user.
摘要翻译: 技术被描述为为包括近眼,增强现实(AR)显示器的个人A / V设备的用户提供虚拟观众体验。 参与第一个3D坐标系统中第一个位置的事件的事件对象的位置音量被接收并映射到远离事件发生的第二个位置的第二个3D坐标系中的第二个位置卷。 确定第二位置处的近眼AR显示的显示视野,并且将表示位于显示视野内的一个或多个事件对象的实时3D虚拟数据显示在近眼睛AR中 显示。 用户可以选择查看事件的观看位置。 此外,可以在相对于第一用户的位置处显示第二用户的虚拟数据。
-
公开(公告)号:US09229231B2
公开(公告)日:2016-01-05
申请号:US13346674
申请日:2012-01-09
CPC分类号: G02B27/017 , G02B2027/0138 , G02B2027/014 , G06F3/013 , G06F3/017 , G06F3/0483 , G06F3/167 , G10L2015/228
摘要: The technology provides for updating printed content with personalized virtual data using a see-through, near-eye, mixed reality display device system. A printed content item, for example a book or magazine, is identified from image data captured by cameras on the display device, and user selection of a printed content selection within the printed content item is identified based on physical action user input, for example eye gaze or a gesture. Virtual data is selected from available virtual data for the printed content selection based on user profile data, and the display device system displays the selected virtual data in a position registered to the position of the printed content selection. In some examples, a task related to the printed content item is determined based on physical action user input, and personalized virtual data is displayed registered to the printed content item in accordance with the task.
摘要翻译: 该技术提供使用透视,近眼,混合的现实显示设备系统来更新具有个性化虚拟数据的打印内容。 从显示装置上的照相机拍摄的图像数据识别出打印的内容项目,例如书籍或杂志,并且基于物理动作用户输入来识别打印内容项目内的打印内容选择的用户选择,例如眼睛 注视或手势。 基于用户简档数据从打印内容选择的可用虚拟数据中选择虚拟数据,并且显示设备系统将所选择的虚拟数据显示在登记在打印内容选择位置的位置。 在一些示例中,基于物理动作用户输入确定与打印的内容项相关的任务,并且根据任务将个性化虚拟数据显示登记到打印内容项。
-
公开(公告)号:US09183807B2
公开(公告)日:2015-11-10
申请号:US13347576
申请日:2012-01-10
CPC分类号: G09G5/00 , G02B27/017 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G06F3/011 , G06F3/013 , G06F3/015 , G06F3/017 , G06F3/0346 , G06F3/0483 , G06F3/04842 , G06T19/006 , G09G2354/00 , G09G2380/14
摘要: The technology provides embodiments for displaying virtual data as printed content by a see-through, near-eye, mixed reality display device system. One or more literary content items registered to a reading object in a field of view of the display device system are displayed with print layout characteristics. Print layout characteristics from a publisher of each literary content item are selected if available. The reading object has a type like a magazine, book, journal or newspaper and may be a real object or a virtual object displayed by the display device system. The reading object type of the virtual object is based on a reading object type associated with a literary content item to be displayed. Virtual augmentation data registered to a literary content item is displayed responsive to detecting user physical action in image data. An example of a physical action is a page flipping gesture.
摘要翻译: 该技术提供了通过透视,近眼,混合现实显示设备系统将虚拟数据显示为打印内容的实施例。 在显示装置系统的视野中登记到读取对象的一个或多个文学内容项以打印布局特征显示。 选择每个文学内容项目的发布者的打印布局特征(如果可用)。 读取对象具有类似于杂志,书籍,日记或报纸的类型,并且可以是由显示设备系统显示的真实对象或虚拟对象。 虚拟对象的读取对象类型基于与要显示的文学内容项相关联的读取对象类型。 响应于检测到图像数据中的用户身体动作,显示登记到文学内容项目的虚拟增强数据。 物理动作的一个例子是翻页手势。
-
54.
公开(公告)号:US09153195B2
公开(公告)日:2015-10-06
申请号:US13361923
申请日:2012-01-30
申请人: Kevin A. Geisner , Darren Bennett , Relja Markovic , Stephen G. Latta , Daniel J. McCulloch , Jason Scott , Ryan L. Hastings , Alex Aben-Athar Kipman , Andrew John Fuller , Jeffrey Neil Margolis , Kathryn Stone Perez , Sheridan Martin Small
发明人: Kevin A. Geisner , Darren Bennett , Relja Markovic , Stephen G. Latta , Daniel J. McCulloch , Jason Scott , Ryan L. Hastings , Alex Aben-Athar Kipman , Andrew John Fuller , Jeffrey Neil Margolis , Kathryn Stone Perez , Sheridan Martin Small
CPC分类号: G06T19/006 , G02B27/0172 , G02B2027/0138 , G02B2027/014 , G06F3/002 , G06F3/011 , G06F3/012 , G06F3/013 , G06F3/04842 , G06Q50/01 , G09G5/00
摘要: The technology provides contextual personal information by a mixed reality display device system being worn by a user. A user inputs person selection criteria, and the display system sends a request for data identifying at least one person in a location of the user who satisfy the person selection criteria to a cloud based application with access to user profile data for multiple users. Upon receiving data identifying the at least one person, the display system outputs data identifying the person if he or she is within the field of view. An identifier and a position indicator of the person in the location is output if not. Directional sensors on the display device may also be used for determining a position of the person. Cloud based executing software can identify and track the positions of people based on image and non-image data from display devices in the location.
摘要翻译: 该技术通过由用户佩戴的混合现实显示设备系统来提供上下文的个人信息。 用户输入人物选择标准,并且显示系统向满足用户选择标准的用户的位置的至少一个人发送数据请求,该用户可以访问多个用户的用户简档数据。 在接收到识别至少一个人的数据时,如果他或她在视野内,则显示系统输出识别该人的数据。 如果不是,则输出该位置的人的标识符和位置指示符。 显示装置上的定向传感器也可以用于确定人的位置。 基于云的执行软件可以根据位置上的显示设备的图像和非图像数据来识别和跟踪人员的位置。
-
公开(公告)号:US09105210B2
公开(公告)日:2015-08-11
申请号:US13538829
申请日:2012-06-29
申请人: Mathew J. Lamb , Ben J. Sugden , Robert L. Crocco, Jr. , Brian E. Keane , Christopher E. Miles , Kathryn Stone Perez , Laura K. Massey , Alex Aben-Athar Kipman
发明人: Mathew J. Lamb , Ben J. Sugden , Robert L. Crocco, Jr. , Brian E. Keane , Christopher E. Miles , Kathryn Stone Perez , Laura K. Massey , Alex Aben-Athar Kipman
CPC分类号: G09G3/003 , G02B27/017 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , G06F3/1431 , G09G2370/022 , H04N2201/3245 , H04N2201/3269
摘要: A system for identifying an AR tag and determining a location for a virtual object within an augmented reality environment corresponding with the AR tag is described. In some environments, including those with viewing obstructions, the identity of the AR tag and the location of a corresponding virtual object may be determined by aggregating individual identity and location determinations from a plurality of head-mounted display devices (HMDs). The virtual object may comprise a shared virtual object that is viewable from each of the plurality of HMDs as existing at a shared location within the augmented reality environment. The shared location may comprise a weighted average of individual location determinations from each of the plurality of HMDs. By aggregating and analyzing individual identity and location determinations, a particular HMD of the plurality of HMDs may display a virtual object without having to identify a corresponding AR tag directly.
摘要翻译: 描述用于识别AR标签并确定与AR标签相对应的增强现实环境中的虚拟对象的位置的系统。 在一些环境中,包括具有观察障碍物的环境中,AR标签的身份和相应的虚拟对象的位置可以通过从多个头戴式显示设备(HMD)聚合个体身份和位置确定来确定。 虚拟对象可以包括可从多个HMD中的每一个查看的共享虚拟对象,其存在于增强现实环境中的共享位置处。 共享位置可以包括来自多个HMD中的每一个的各个位置确定的加权平均。 通过聚合和分析个体身份和位置确定,多个HMD中的特定HMD可以显示虚拟对象,而不必直接识别对应的AR标签。
-
公开(公告)号:US09035955B2
公开(公告)日:2015-05-19
申请号:US13473268
申请日:2012-05-16
申请人: Brian E. Keane , Ben J. Sugden , Robert L. Crocco, Jr. , Christopher E. Miles , Kathryn Stone Perez , Laura K. Massey , Mathew J. Lamb , Alex Aben-Athar Kipman
发明人: Brian E. Keane , Ben J. Sugden , Robert L. Crocco, Jr. , Christopher E. Miles , Kathryn Stone Perez , Laura K. Massey , Mathew J. Lamb , Alex Aben-Athar Kipman
IPC分类号: G06T13/20 , G10L21/10 , G06F3/01 , G06F3/0483 , G06T19/00 , G10L15/26 , G10L25/03 , G09B5/06 , G03H1/22
CPC分类号: G06F3/0483 , G03H1/2294 , G03H2001/2284 , G03H2227/02 , G03H2270/55 , G06F3/011 , G06F3/1415 , G06T19/006 , G09B5/062 , G10L15/26 , G10L21/10 , G10L25/03 , G10L2021/105
摘要: A system for generating and displaying holographic visual aids associated with a story to an end user of a head-mounted display device while the end user is reading the story or perceiving the story being read aloud is described. The story may be embodied within a reading object (e.g., a book) in which words of the story may be displayed to the end user. The holographic visual aids may include a predefined character animation that is synchronized to a portion of the story corresponding with the character being animated. A reading pace of a portion of the story may be used to control the playback speed of the predefined character animation in real-time such that the character is perceived to be lip-syncing the story being read aloud. In some cases, an existing book without predetermined AR tags may be augmented with holographic visual aids.
摘要翻译: 描述了一种用于在最终用户正在阅读故事或感知故事被朗读的情况下向头戴式显示装置的终端用户生成和显示与故事相关联的全息视觉辅助装置的系统。 该故事可以体现在阅读对象(例如书籍)中,其中故事的话可以被显示给终端用户。 全息视觉辅助工具可以包括预定义的角色动画,其与与动画的角色对应的故事的一部分同步。 故事的一部分的阅读速度可以用于实时控制预定义的角色动画的播放速度,使得角色被感知为大声朗读故事的唇部同步。 在某些情况下,可以利用全息视觉辅助来增加没有预定AR标签的现有书。
-
公开(公告)号:US08988463B2
公开(公告)日:2015-03-24
申请号:US12963547
申请日:2010-12-08
申请人: Kathryn Stone Perez , Alex Aben-Athar Kipman , Andrew Fuller , Philip Greenhalgh , David Hayes , John Tardif
发明人: Kathryn Stone Perez , Alex Aben-Athar Kipman , Andrew Fuller , Philip Greenhalgh , David Hayes , John Tardif
CPC分类号: G02B27/0172 , G02B2027/0127 , G02B2027/0178 , G02B2027/0187 , G06T19/006 , G09G5/377
摘要: A method for overlaying first and second images in a common focal plane of a viewer comprises forming the first image and guiding the first and second images along an axis to a pupil of the viewer. The method further comprises adjustably diverging the first and second images at an adaptive diverging optic to bring the first image into focus at the common focal plane, and, adjustably converging the second image at an adaptive converging optic to bring the second image into focus at the common focal plane.
摘要翻译: 用于将第一和第二图像重叠在观看者的公共焦平面中的方法包括形成第一图像并沿着轴将第一和第二图像引导至观看者的瞳孔。 该方法还包括在自适应发散光学器件处可调节地分散第一和第二图像以使第一图像在公共焦平面处聚焦,并且可调节地将自适应会聚光学器件上的第二图像会聚,以使第二图像在 共同焦平面。
-
公开(公告)号:US08773355B2
公开(公告)日:2014-07-08
申请号:US12405047
申请日:2009-03-16
IPC分类号: G06F3/033
CPC分类号: A63F13/428 , A63F13/10 , A63F13/213 , A63F13/79 , A63F2300/1093 , A63F2300/6045 , G06F3/011
摘要: Disclosed herein are systems and methods for controlling a computing environment with one or more gestures by sizing a virtual screen centered on a user, and by adapting the response of the computing environment to gestures made by a user and modes of use exhibited by a user. The virtual screen may be sized using depth, aspects of the user such as height and/or user profile information such as age and ability. Modes of use by a user may also be considered in determining the size of the virtual screen and the control of the system, the modes being based on profile information and/or information from a capture device.
摘要翻译: 本文公开了用于通过利用以用户为中心的虚拟屏幕的大小调整并且通过使计算环境的响应适应于由用户呈现的手势和由用户呈现的使用模式而用一个或多个手势来控制计算环境的系统和方法。 可以使用深度,用户的方面(例如身高和/或用户简档信息,例如年龄和能力)来确定虚拟屏幕的大小。 在确定虚拟屏幕的大小和系统的控制时,也可以考虑用户的使用模式,这些模式基于简档信息和/或来自捕获设备的信息。
-
公开(公告)号:US20140006026A1
公开(公告)日:2014-01-02
申请号:US13538731
申请日:2012-06-29
申请人: Mathew J. Lamb , Ben J. Sugden , Robert L. Crocco, JR. , Brian E. Keane , Christopher E. Miles , Kathryn Stone Perez , Laura K. Massey , Alex Aben-Athar Kipman
发明人: Mathew J. Lamb , Ben J. Sugden , Robert L. Crocco, JR. , Brian E. Keane , Christopher E. Miles , Kathryn Stone Perez , Laura K. Massey , Alex Aben-Athar Kipman
摘要: A system for generating one or more enhanced audio signals such that one or more sound levels corresponding with sounds received from one or more sources of sound within an environment may be dynamically adjusted based on contextual information is described. The one or more enhanced audio signals may be generated by a head-mounted display device (HMD) worn by an end user within the environment and outputted to earphones associated with the HMD such that the end user may listen to the one or more enhanced audio signals in real-time. In some cases, each of the one or more sources of sound may correspond with a priority level. The priority level may be dynamically assigned depending on whether the end user of the HMD is focusing on a particular source of sound or has specified a predetermined level of importance corresponding with the particular source of sound.
摘要翻译: 描述了一种用于生成一个或多个增强音频信号的系统,以便可以基于上下文信息来动态地调整与环境中的一个或多个声源所接收的声音相对应的一个或多个声级。 一个或多个增强音频信号可以由环境中终端用户佩戴的头戴式显示设备(HMD)产生,并且输出到与HMD相关联的耳机,使得终端用户可以收听一个或多个增强音频 信号实时。 在一些情况下,一个或多个声源中的每一个可以对应于优先级。 可以根据HMD的最终用户是聚焦于特定的声源还是指定了与特定的声源相对应的预定重要程度,来动态地分配优先级。
-
公开(公告)号:US20130321462A1
公开(公告)日:2013-12-05
申请号:US13487079
申请日:2012-06-01
申请人: Tom G. Salter , Alex Aben-Athar Kipman , Ben J. Sugden , Robert L. Crocco, JR. , Brian E. Keane , Christopher E. Miles , Kathryn Stone Perez , Laura K. Massey , Mathew J. Lamb
发明人: Tom G. Salter , Alex Aben-Athar Kipman , Ben J. Sugden , Robert L. Crocco, JR. , Brian E. Keane , Christopher E. Miles , Kathryn Stone Perez , Laura K. Massey , Mathew J. Lamb
摘要: Techniques are provided for allowing a user to select a region within virtual imagery, such as a hologram, being presented in an HMD. The user could select the region by using their hands to form a closed loop such that from the perspective of the user, the closed loop corresponds to the region the user wishes to select. The user could select the region by using a prop, such as a picture frame. In response to the selection, the selected region could be presented using a different rendering technique than other regions of the virtual imagery. Various rendering techniques such as zooming, filtering, etc. could be applied to the selected region. The identification of the region by the user could also serve as a selection of an element in that portion of the virtual image.
摘要翻译: 提供了技术来允许用户选择呈现在HMD中的虚拟图像(例如全息图)内的区域。 用户可以通过使用他们的手来选择该区域以形成闭环,使得从用户的角度来看,闭环对应于用户希望选择的区域。 用户可以通过使用支架(如相框)来选择该区域。 响应于选择,可以使用与虚拟图像的其他区域不同的渲染技术呈现所选择的区域。 各种渲染技术,例如缩放,滤波等可以应用于所选择的区域。 用户对区域的识别也可以用作该虚拟图像的该部分中的元素的选择。
-
-
-
-
-
-
-
-
-