公开(公告)号：US20130083018A1

公开(公告)日：2013-04-04

申请号：US13430972

申请日：2012-03-27

申请人： Kevin A. Geisner ,  Stephen G. Latta ,  Ben J. Sugden ,  Benjamin I. Vaught ,  Alex Aben-Athar Kipman ,  Kathryn Stone Perez

发明人： Kevin A. Geisner ,  Stephen G. Latta ,  Ben J. Sugden ,  Benjamin I. Vaught ,  Alex Aben-Athar Kipman ,  Kathryn Stone Perez

IPC分类号： G06T17/00 ,  G09G5/00

CPC分类号： G06F3/011

摘要： A system for generating an augmented reality environment using state-based virtual objects is described. A state-based virtual object may be associated with a plurality of different states. Each state of the plurality of different states may correspond with a unique set of triggering events different from those of any other state. The set of triggering events associated with a particular state may be used to determine when a state change from the particular state is required. In some cases, each state of the plurality of different states may be associated with a different 3-D model or shape. The plurality of different states may be defined using a predetermined and standardized file format that supports state-based virtual objects. In some embodiments, one or more potential state changes from a particular state may be predicted based on one or more triggering probabilities associated with the set of triggering events.

摘要翻译： 描述使用基于状态的虚拟对象来生成增强现实环境的系统。 基于状态的虚拟对象可以与多个不同的状态相关联。 多个不同状态的每个状态可以对应于与任何其他状态不同的唯一的触发事件集合。 可以使用与特定状态相关联的一组触发事件来确定何时需要状态从特定状态改变。 在一些情况下，多个不同状态的每个状态可以与不同的3-D模型或形状相关联。 可以使用支持基于状态的虚拟对象的预定和标准化文件格式来定义多个不同的状态。 在一些实施例中，可以基于与该组触发事件相关联的一个或多个触发概率来预测来自特定状态的一个或多个潜在状态改变。

公开(公告)号：US09286711B2

公开(公告)日：2016-03-15

申请号：US13535213

申请日：2012-06-27

申请人： Kevin A. Geisner ,  Kathryn Stone Perez ,  Stephen G. Latta ,  Ben J. Sugden ,  Benjamin I. Vaught ,  Alex Aben-Athar Kipman ,  John Clavin ,  Jonathan T. Steed ,  Jason Scott

发明人： Kevin A. Geisner ,  Kathryn Stone Perez ,  Stephen G. Latta ,  Ben J. Sugden ,  Benjamin I. Vaught ,  Alex Aben-Athar Kipman ,  John Clavin ,  Jonathan T. Steed ,  Jason Scott

IPC分类号： G09G5/00 ,  G06T15/00 ,  G06T19/00 ,  G08G1/00 ,  G02B27/01 ,  G06F3/147 ,  G09G3/00

CPC分类号： G06T15/00 ,  G02B27/017 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F1/163 ,  G06F3/011 ,  G06F3/013 ,  G06F3/147 ,  G06T19/006 ,  G08G1/00 ,  G09G3/003 ,  G09G5/00

摘要： Technology is described for representing a physical location at a previous time period with three dimensional (3D) virtual data displayed by a near-eye, augmented reality display of a personal audiovisual (A/V) apparatus. The personal A/V apparatus is identified as being within the physical location, and one or more objects in a display field of view of the near-eye, augmented reality display are automatically identified based on a three dimensional mapping of objects in the physical location. User input, which may be natural user interface (NUI) input, indicates a previous time period, and one or more 3D virtual objects associated with the previous time period are displayed from a user perspective associated with the display field of view. An object may be erased from the display field of view, and a camera effect may be applied when changing between display fields of view.

摘要翻译： 描述了用于通过由个人视听（A / V）设备的近眼，增强的现实显示显示的三维（3D）虚拟数据来表示前一时间段的物理位置的技术。 个人A / V设备被识别为在物理位置之内，并且基于物理位置中的对象的三维映射来自动识别近眼增强现实显示器的显示视野中的一个或多个对象 。 可以是自然用户界面（NUI）输入的用户输入指示先前的时间段，并且从与显示视野相关联的用户视角显示与前一时间段相关联的一个或多个3D虚拟对象。 可以从显示视野擦除对象，并且可以在显示视野之间切换时应用相机效果。

公开(公告)号：US09606992B2

公开(公告)日：2017-03-28

申请号：US13535074

申请日：2012-06-27

申请人： Kevin A. Geisner ,  Kathryn Stone Perez ,  Stephen G. Latta ,  Ben J. Sugden ,  Benjamin I. Vaught ,  Alex Aben-Athar Kipman ,  Jeffrey A. Kohler ,  Daniel J. McCulloch

发明人： Kevin A. Geisner ,  Kathryn Stone Perez ,  Stephen G. Latta ,  Ben J. Sugden ,  Benjamin I. Vaught ,  Alex Aben-Athar Kipman ,  Jeffrey A. Kohler ,  Daniel J. McCulloch

IPC分类号： G09G5/00 ,  G06F17/30 ,  G09G3/00 ,  G06F3/01 ,  G09G5/12

CPC分类号： G06F17/30047 ,  G06F3/011 ,  G09G3/003 ,  G09G5/12 ,  G09G2340/12 ,  G09G2380/00

摘要： Technology is described for resource management based on data including image data of a resource captured by at least one capture device of at least one personal audiovisual (A/V) apparatus including a near-eye, augmented reality (AR) display. A resource is automatically identified from image data captured by at least one capture device of at least one personal A/V apparatus and object reference data. A location in which the resource is situated and a 3D space position or volume of the resource in the location is tracked. A property of the resource is also determined from the image data and tracked. A function of a resource may also be stored for determining whether the resource is usable for a task. Responsive to notification criteria for the resource being satisfied, image data related to the resource is displayed on the near-eye AR display.

公开(公告)号：US20150049114A1

公开(公告)日：2015-02-19

申请号：US14472267

申请日：2014-08-28

申请人： Kevin A. Geisner ,  Kathryn Stone Perez ,  Stephen G. Latta ,  Ben J. Sugden ,  Benjamin I. Vaught ,  Alex Aben-Athar Kipman

发明人： Kevin A. Geisner ,  Kathryn Stone Perez ,  Stephen G. Latta ,  Ben J. Sugden ,  Benjamin I. Vaught ,  Alex Aben-Athar Kipman

IPC分类号： G09G3/00 ,  A63F13/816 ,  A63B71/00 ,  G02B27/01 ,  G06T19/00

CPC分类号： G09G3/003 ,  A63B71/00 ,  A63F13/02 ,  A63F13/216 ,  A63F13/816 ,  A63F2300/301 ,  A63F2300/308 ,  A63F2300/8082 ,  G02B27/0101 ,  G02B27/017 ,  G02B27/0172 ,  G02B2027/014 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06T19/006 ,  G09G2320/068 ,  G09G2320/0693 ,  G09G2380/00

摘要： The technology described herein includes a see-through, near-eye, mixed reality display device for providing customized experiences for a user. The personal A/V apparatus serves as an exercise program that is always with the user, provides motivation for the user, visually tells the user how to exercise, and lets the user exercise with other people who are not present.

摘要翻译： 本文描述的技术包括用于为用户提供定制体验的透视，近眼，混合现实显示设备。 个人A / V设备作为一个总是与用户一起锻炼的锻炼计划，为用户提供动机，视觉上告诉用户锻炼身体，并让用户锻炼身体不在场的其他人。

公开(公告)号：US20130095924A1

公开(公告)日：2013-04-18

申请号：US13631511

申请日：2012-09-28

申请人： Kevin A. Geisner ,  Kathryn Stone Perez ,  Stephen G. Latta ,  Ben J. Sugden ,  Benjamin I. Vaught ,  Alex Aben-Athar Kipman ,  John Clavin

发明人： Kevin A. Geisner ,  Kathryn Stone Perez ,  Stephen G. Latta ,  Ben J. Sugden ,  Benjamin I. Vaught ,  Alex Aben-Athar Kipman ,  John Clavin

IPC分类号： A63F13/00

CPC分类号： A63F13/213 ,  A63F2300/1093 ,  A63F2300/204 ,  A63F2300/301 ,  A63F2300/6676 ,  A63F2300/69 ,  G02B27/017 ,  G02B2027/014 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F3/012 ,  G06F3/013 ,  G06T19/006 ,  G09B19/0038 ,  H04N13/344 ,  H04N13/366 ,  H04N13/383

摘要： Technology is described for providing a personalized sport performance experience with three dimensional (3D) virtual data displayed by a near-eye, augmented reality display of a personal audiovisual (A/V) apparatus. A physical movement recommendation is determined for the user performing a sport based on skills data for the user for the sport, physical characteristics of the user, and 3D space positions for at least one or more sport objects. 3D virtual data depicting one or more visual guides for assisting the user in performing the physical movement recommendation may be displayed from a user perspective associated with a display field of view of the near-eye AR display. An avatar may also be displayed by the near-eye AR display performing a sport. The avatar may perform the sport interactively with the user or be displayed performing a prior performance of an individual represented by the avatar.

摘要翻译： 描述了技术，用于通过个人视听（A / V）设备的近眼，增强现实显示显示的三维（3D）虚拟数据来提供个性化的运动表现体验。 基于运动用户的技能数据，用户的身体特征以及用于至少一个或多个运动对象的3D空间位置，为执行运动的用户确定身体运动推荐。 可以从与近眼AR显示器的显示视野相关联的用户视角来显示描绘用于辅助用户执行物理移动推荐的一个或多个视觉指南的3D虚拟数据。 化身也可以由执行运动的近眼AR显示器显示。 化身可以与用户交互地执行运动，或者显示执行由化身表示的个人的先前的表现。

公开(公告)号：US20130085345A1

公开(公告)日：2013-04-04

申请号：US13436526

申请日：2012-03-30

申请人： Kevin A. Geisner ,  Kathryn Stone Perez ,  Stephen G. Latta ,  Ben J. Sugden ,  Benjamin I. Vaught ,  Alex Aben-Athar Kipman ,  Cameron G. Brown ,  Holly A. Hirzel ,  Brian J. Mount ,  Daniel McCulloch

发明人： Kevin A. Geisner ,  Kathryn Stone Perez ,  Stephen G. Latta ,  Ben J. Sugden ,  Benjamin I. Vaught ,  Alex Aben-Athar Kipman ,  Cameron G. Brown ,  Holly A. Hirzel ,  Brian J. Mount ,  Daniel McCulloch

IPC分类号： A61B5/00 ,  G09G5/00

CPC分类号： G06Q30/00 ,  G02B27/017 ,  G02B2027/0138 ,  G02B2027/014

摘要： A system provides a recommendation of food items to a user based on nutritional preferences of the user, using a head-mounted display device (HMDD) worn by the user. In a store, a forward-facing camera of the HMDD captures an image of a food item. The food item can be identified by the image, such as based on packaging of the food item. Nutritional parameters of the food item are compared to nutritional preferences of the user to determine whether the food item is recommended. The HMDD displays an augmented reality image to the user indicating whether the food item is recommended. If the food item is not recommended, a substitute food item can be identified. The nutritional preferences can indicate food allergies, preferences for low calorie foods and so forth. In a restaurant, the HMDD can recommend menu selections for a user.

摘要翻译： 系统使用由用户佩戴的头戴式显示装置（HMDD），基于使用者的营养偏好向使用者提供食品的推荐。 在商店中，HMDD的面向前的照相机捕获食物的图像。 食物可以通过图像来识别，例如基于食品的包装。 将食物的营养参数与用户的营养偏好进行比较，以确定食品是否被推荐。 HMDD向用户显示增强现实图像，指示食品是否被推荐。 如果不推荐食品，可以确定替代食品。 营养偏好可以指示食物过敏，低热量食物的喜好等等。 在餐厅，HMDD可以为用户推荐菜单选择。

公开(公告)号：US20130084970A1

公开(公告)日：2013-04-04

申请号：US13445616

申请日：2012-04-12

申请人： Kevin A. Geisner ,  Stephen G. Latta ,  Ben J. Sugden ,  Benjamin I. Vaught ,  Alex Aben-Athar Kipman ,  Kathryn Stone Perez ,  Ryan L. Hastings ,  Jason Scott ,  Darren A. Bennett ,  John Clavin ,  Daniel McCulloch

发明人： Kevin A. Geisner ,  Stephen G. Latta ,  Ben J. Sugden ,  Benjamin I. Vaught ,  Alex Aben-Athar Kipman ,  Kathryn Stone Perez ,  Ryan L. Hastings ,  Jason Scott ,  Darren A. Bennett ,  John Clavin ,  Daniel McCulloch

IPC分类号： A63F13/02 ,  A63F13/12

CPC分类号： A63F13/65 ,  A63F13/02 ,  A63F13/10 ,  A63F13/12 ,  A63F13/213 ,  A63F13/216 ,  A63F2300/1031 ,  A63F2300/301 ,  A63F2300/308

摘要： A game can be created, shared and played using a personal audio/visual apparatus such as a head-mounted display device (HMDD). Rules of the game, and a configuration of the game space, can be standard or custom. Boundary points of the game can be defined by a gaze direction of the HMDD, by the user's location, by a model of a physical game space such as an instrumented court or by a template. Players can be identified and notified of the availability of a game using a server push technology. For example, a user in a particular location may be notified of the availability of a game at that location. A server manages the game, including storing the rules, boundaries and a game state. The game state can identify players and their scores. Real world objects can be imaged and provided as virtual objects in the game space.

摘要翻译： 可以使用诸如头戴式显示装置（HMDD）的个人音频/视频装置来创建，共享和播放游戏。 游戏规则和游戏空间的配置可以是标准的或习惯的。 游戏的边界点可以通过HMDD的注视方向，用户的位置，物理游戏空间的模型，如仪器法庭或模板来定义。 使用服务器推送技术，玩家可以识别和通知游戏的可用性。 例如，可以向特定位置的用户通知该位置处的游戏的可用性。 服务器管理游戏，包括存储规则，边界和游戏状态。 游戏状态可以识别玩家及其成绩。 真实世界的对象可以被成像并作为虚拟对象提供给游戏空间。

公开(公告)号：US20130083064A1

公开(公告)日：2013-04-04

申请号：US13535074

申请日：2012-06-27

申请人： Kevin A. Geisner ,  Kathryn Stone Perez ,  Stephen G. Latta ,  Ben J. Sugden ,  Benjamin I. Vaught ,  Alex Aben-Athar Kipman ,  Jeffrey A. Kohler ,  Daniel J. McCulloch

发明人： Kevin A. Geisner ,  Kathryn Stone Perez ,  Stephen G. Latta ,  Ben J. Sugden ,  Benjamin I. Vaught ,  Alex Aben-Athar Kipman ,  Jeffrey A. Kohler ,  Daniel J. McCulloch

IPC分类号： G09G5/08 ,  G06K9/62 ,  G09G5/00

CPC分类号： G06F17/30047 ,  G06F3/011 ,  G09G3/003 ,  G09G5/12 ,  G09G2340/12 ,  G09G2380/00

摘要： Technology is described for resource management based on data including image data of a resource captured by at least one capture device of at least one personal audiovisual (A/V) apparatus including a near-eye, augmented reality (AR) display. A resource is automatically identified from image data captured by at least one capture device of at least one personal A/V apparatus and object reference data. A location in which the resource is situated and a 3D space position or volume of the resource in the location is tracked. A property of the resource is also determined from the image data and tracked. A function of a resource may also be stored for determining whether the resource is usable for a task. Responsive to notification criteria for the resource being satisfied, image data related to the resource is displayed on the near-eye AR display.

摘要翻译： 基于包括由包括近眼，增强现实（AR）显示）的至少一个个人视听（A / V）装置的至少一个捕获装置捕获的资源的图像数据的数据描述技术。 从由至少一个个人A / V设备和对象参考数据的至少一个捕获设备捕获的图像数据自动识别资源。 资源所位于的位置以及该位置资源的3D空间位置或体积被跟踪。 资源的属性也根据图像数据确定并进行跟踪。 也可以存储资源的功能，以确定资源是否可用于任务。 响应于资源的通知标准，与资源相关的图像数据显示在近眼AR显示器上。

公开(公告)号：US20130083011A1

公开(公告)日：2013-04-04

申请号：US13535213

申请日：2012-06-27

申请人： Kevin A. Geisner ,  Kathryn Stone Perez ,  Stephen G. Latta ,  Ben J. Sugden ,  Benjamin I. Vaught ,  Alex Aben-Athar Kipman ,  John Clavin ,  Jonathan T. Steed ,  Jason Scott

发明人： Kevin A. Geisner ,  Kathryn Stone Perez ,  Stephen G. Latta ,  Ben J. Sugden ,  Benjamin I. Vaught ,  Alex Aben-Athar Kipman ,  John Clavin ,  Jonathan T. Steed ,  Jason Scott

IPC分类号： G09G5/00 ,  G06T15/00

CPC分类号： G06T15/00 ,  G02B27/017 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F1/163 ,  G06F3/011 ,  G06F3/013 ,  G06F3/147 ,  G06T19/006 ,  G08G1/00 ,  G09G3/003 ,  G09G5/00

摘要： Technology is described for representing a physical location at a previous time period with three dimensional (3D) virtual data displayed by a near-eye, augmented reality display of a personal audiovisual (A/V) apparatus. The personal A/V apparatus is identified as being within the physical location, and one or more objects in a display field of view of the near-eye, augmented reality display are automatically identified based on a three dimensional mapping of objects in the physical location. User input, which may be natural user interface (NUI) input, indicates a previous time period, and one or more 3D virtual objects associated with the previous time period are displayed from a user perspective associated with the display field of view. An object may be erased from the display field of view, and a camera effect may be applied when changing between display fields of view.

摘要翻译： 描述了用于通过由个人视听（A / V）设备的近眼，增强的现实显示显示的三维（3D）虚拟数据来表示前一时间段的物理位置的技术。 个人A / V设备被识别为在物理位置之内，并且基于物理位置中的对象的三维映射来自动识别近眼增强现实显示器的显示视野中的一个或多个对象 。 可以是自然用户界面（NUI）输入的用户输入指示先前的时间段，并且从与显示视野相关联的用户视角显示与前一时间段相关联的一个或多个3D虚拟对象。 可以从显示视野擦除对象，并且可以在显示视野之间切换时应用相机效果。

公开(公告)号：US20130083009A1

公开(公告)日：2013-04-04

申请号：US13436499

申请日：2012-03-30

申请人： Kevin A. Geisner ,  Kathryn Stone Perez ,  Stephen G. Latta ,  Ben J. Sugden ,  Benjamin I. Vaught ,  Alex Aben-Athar Kipman

发明人： Kevin A. Geisner ,  Kathryn Stone Perez ,  Stephen G. Latta ,  Ben J. Sugden ,  Benjamin I. Vaught ,  Alex Aben-Athar Kipman

IPC分类号： G09G5/00 ,  G06T15/00

CPC分类号： G09G3/003 ,  A63B71/00 ,  A63F13/02 ,  A63F13/216 ,  A63F13/816 ,  A63F2300/301 ,  A63F2300/308 ,  A63F2300/8082 ,  G02B27/0101 ,  G02B27/017 ,  G02B27/0172 ,  G02B2027/014 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06T19/006 ,  G09G2320/068 ,  G09G2320/0693 ,  G09G2380/00

摘要： The technology described herein includes a see-through, near-eye, mixed reality display device for providing customized experiences for a user. The personal A/V apparatus serves as an exercise program that is always with the user, provides motivation for the user, visually tells the user how to exercise, and lets the user exercise with other people who are not present.