公开(公告)号：US09041622B2

公开(公告)日：2015-05-26

申请号：US13494989

申请日：2012-06-12

申请人： Daniel J. McCulloch ,  Arnulfo Zepeda Navratil ,  Jonathan T. Steed ,  Ryan L. Hastings ,  Jason Scott ,  Brian J. Mount ,  Holly A. Hirzel ,  Darren Bennett ,  Michael J. Scavezze

发明人： Daniel J. McCulloch ,  Arnulfo Zepeda Navratil ,  Jonathan T. Steed ,  Ryan L. Hastings ,  Jason Scott ,  Brian J. Mount ,  Holly A. Hirzel ,  Darren Bennett ,  Michael J. Scavezze

IPC分类号： G09G5/00 ,  G02B27/01 ,  G06F3/01

CPC分类号： G02B27/01 ,  G02B27/017 ,  G02B2027/014 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F3/012 ,  G06F3/013 ,  G06F3/016 ,  G06F3/017

摘要： Technology is described for controlling a virtual object displayed by a near-eye, augmented reality display with a real controller device. User input data is received from a real controller device requesting an action to be performed by the virtual object. A user perspective of the virtual object being displayed by the near-eye, augmented reality display is determined. The user input data requesting the action to be performed by the virtual object is applied based on the user perspective, and the action is displayed from the user perspective. The virtual object to be controlled by the real controller device may be identified based on user input data which may be from a natural user interface (NUI). A user selected force feedback object may also be identified, and the identification may also be based on NUI input data.

摘要翻译： 描述了用于通过实际控制器设备控制由近眼，增强现实显示显示的虚拟对象的技术。 从实际控制器设备接收用户输入数据，请求由虚拟对象执行的动作。 确定由近眼增强现实显示显示的虚拟对象的用户透视图。 基于用户的观点，应用用户输入要求由虚拟对象执行的动作的数据，从用户的角度显示动作。 可以基于可以来自自然用户界面（NUI）的用户输入数据来识别要由真实控制器设备控制的虚拟对象。 还可以识别用户选择的力反馈对象，并且该标识也可以基于NUI输入数据。

公开(公告)号：US20130328762A1

公开(公告)日：2013-12-12

申请号：US13494989

申请日：2012-06-12

申请人： Daniel J. McCulloch ,  Arnulfo Zepeda Navratil ,  Jonathan T. Steed ,  Ryan L. Hastings ,  Jason Scott ,  Brian J. Mount ,  Holly A. Hirzel ,  Darren Bennett ,  Michael J. Scavezze

发明人： Daniel J. McCulloch ,  Arnulfo Zepeda Navratil ,  Jonathan T. Steed ,  Ryan L. Hastings ,  Jason Scott ,  Brian J. Mount ,  Holly A. Hirzel ,  Darren Bennett ,  Michael J. Scavezze

IPC分类号： G06F3/01

CPC分类号： G02B27/01 ,  G02B27/017 ,  G02B2027/014 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F3/012 ,  G06F3/013 ,  G06F3/016 ,  G06F3/017

摘要： Technology is described for controlling a virtual object displayed by a near-eye, augmented reality display with a real controller device. User input data is received from a real controller device requesting an action to be performed by the virtual object. A user perspective of the virtual object being displayed by the near-eye, augmented reality display is determined. The user input data requesting the action to be performed by the virtual object is applied based on the user perspective, and the action is displayed from the user perspective. The virtual object to be controlled by the real controller device may be identified based on user input data which may be from a natural user interface (NUI). A user selected force feedback object may also be identified, and the identification may also be based on NUI input data.

摘要翻译： 描述了用于通过实际控制器设备控制由近眼，增强现实显示显示的虚拟对象的技术。 从实际控制器设备接收用户输入数据，请求由虚拟对象执行的动作。 确定由近眼增强现实显示显示的虚拟对象的用户透视图。 基于用户的观点，应用用户输入要求由虚拟对象执行的动作的数据，从用户的角度显示动作。 可以基于可以来自自然用户界面（NUI）的用户输入数据来识别要由真实控制器设备控制的虚拟对象。 还可以识别用户选择的力反馈对象，并且该标识也可以基于NUI输入数据。

公开(公告)号：US20130286004A1

公开(公告)日：2013-10-31

申请号：US13458800

申请日：2012-04-27

申请人： Daniel J. McCulloch ,  Stephen G. Latta ,  Brian J. Mount ,  Kevin A. Geisner ,  Roger Sebastian Kevin Sylvan ,  Arnulfo Zepeda Navratil ,  Jason Scott ,  Jonathan T. Steed ,  Ben J. Sugden ,  Britta Silke Hummel ,  Kyungsuk David Lee ,  Mark J. Finocchio ,  Alex Aben-Athar Kipman ,  Jeffrey N. Margolis

发明人： Daniel J. McCulloch ,  Stephen G. Latta ,  Brian J. Mount ,  Kevin A. Geisner ,  Roger Sebastian Kevin Sylvan ,  Arnulfo Zepeda Navratil ,  Jason Scott ,  Jonathan T. Steed ,  Ben J. Sugden ,  Britta Silke Hummel ,  Kyungsuk David Lee ,  Mark J. Finocchio ,  Alex Aben-Athar Kipman ,  Jeffrey N. Margolis

IPC分类号： G06T15/00

CPC分类号： G06T19/006 ,  G06T2210/21

摘要： Technology is described for displaying a collision between objects by an augmented reality display device system. A collision between a real object and a virtual object is identified based on three dimensional space position data of the objects. At least one effect on at least one physical property of the real object is determined based on physical properties of the real object, like a change in surface shape, and physical interaction characteristics of the collision. Simulation image data is generated and displayed simulating the effect on the real object by the augmented reality display. Virtual objects under control of different executing applications can also interact with one another in collisions.

摘要翻译： 描述了用于通过增强现实显示设备系统显示对象之间的冲突的技术。 基于对象的三维空间位置数据来识别真实对象和虚拟对象之间的冲突。 基于真实物体的物理性质，如表面形状的变化和碰撞的物理相互作用特性，确定对真实物体的至少一种物理性质的至少一种影响。 通过增强现实显示模拟图像数据，模拟对真实物体的影响。 在不同执行应用程序的控制下的虚拟对象也可以在冲突中彼此交互。

公开(公告)号：US09183676B2

公开(公告)日：2015-11-10

申请号：US13458800

申请日：2012-04-27

申请人： Daniel J. McCulloch ,  Stephen G. Latta ,  Brian J. Mount ,  Kevin A. Geisner ,  Roger Sebastian Kevin Sylvan ,  Arnulfo Zepeda Navratil ,  Jason Scott ,  Jonathan T. Steed ,  Ben J. Sugden ,  Britta Silke Hummel ,  Kyungsuk David Lee ,  Mark J. Finocchio ,  Alex Aben-Athar Kipman ,  Jeffrey N. Margolis

发明人： Daniel J. McCulloch ,  Stephen G. Latta ,  Brian J. Mount ,  Kevin A. Geisner ,  Roger Sebastian Kevin Sylvan ,  Arnulfo Zepeda Navratil ,  Jason Scott ,  Jonathan T. Steed ,  Ben J. Sugden ,  Britta Silke Hummel ,  Kyungsuk David Lee ,  Mark J. Finocchio ,  Alex Aben-Athar Kipman ,  Jeffrey N. Margolis

IPC分类号： G06T19/00

CPC分类号： G06T19/006 ,  G06T2210/21

摘要： Technology is described for displaying a collision between objects by an augmented reality display device system. A collision between a real object and a virtual object is identified based on three dimensional space position data of the objects. At least one effect on at least one physical property of the real object is determined based on physical properties of the real object, like a change in surface shape, and physical interaction characteristics of the collision. Simulation image data is generated and displayed simulating the effect on the real object by the augmented reality display. Virtual objects under control of different executing applications can also interact with one another in collisions.

摘要翻译： 描述了用于通过增强现实显示设备系统显示对象之间的冲突的技术。 基于对象的三维空间位置数据来识别真实对象和虚拟对象之间的冲突。 基于真实物体的物理性质，如表面形状的变化和碰撞的物理相互作用特性，确定对真实物体的至少一种物理性质的至少一种影响。 通过增强现实显示模拟图像数据，模拟对真实物体的影响。 在不同执行应用程序的控制下的虚拟对象也可以在冲突中相互交互。

公开(公告)号：US20140306891A1

公开(公告)日：2014-10-16

申请号：US13862210

申请日：2013-04-12

申请人： Stephen G. Latta ,  Adam G. Poulos ,  Cameron G. Brown ,  Daniel J. McCulloch ,  Matthew Kaplan ,  Arnulfo Zepeda Navratil ,  Jon Paulovich ,  Kudo Tsunoda

发明人： Stephen G. Latta ,  Adam G. Poulos ,  Cameron G. Brown ,  Daniel J. McCulloch ,  Matthew Kaplan ,  Arnulfo Zepeda Navratil ,  Jon Paulovich ,  Kudo Tsunoda

IPC分类号： G06F3/01

CPC分类号： G06F3/017 ,  G02B27/017 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F3/011 ,  G06F3/016

摘要： Methods for providing real-time feedback to an end user of a mobile device as they are interacting with or manipulating one or more virtual objects within an augmented reality environment are described. The real-time feedback may comprise visual feedback, audio feedback, and/or haptic feedback. In some embodiments, a mobile device, such as a head-mounted display device (HMD), may determine an object classification associated with a virtual object within an augmented reality environment, detect an object manipulation gesture performed by an end user of the mobile device, detect an interaction with the virtual object based on the object manipulation gesture, determine a magnitude of a virtual force associated with the interaction, and provide real-time feedback to the end user of the mobile device based on the interaction, the magnitude of the virtual force applied to the virtual object, and the object classification associated with the virtual object.

摘要翻译： 描述了在移动设备与增强现实环境中交互或操纵一个或多个虚拟对象时向终端用户提供实时反馈的方法。 实时反馈可以包括视觉反馈，音频反馈和/或触觉反馈。 在一些实施例中，诸如头戴式显示设备（HMD）的移动设备可以确定与增强现实环境中的虚拟对象相关联的对象分类，检测移动设备的最终用户执行的对象操纵手势 基于对象操纵手势来检测与虚拟对象的交互，确定与交互相关联的虚拟力的大小，并且基于相互作用向移动设备的最终用户提供实时反馈，其大小 应用于虚拟对象的虚拟力以及与虚拟对象相关联的对象分类。

公开(公告)号：US20140240351A1

公开(公告)日：2014-08-28

申请号：US13779614

申请日：2013-02-27

申请人： Michael Scavezze ,  Nicholas Gervase Fajt ,  Arnulfo Zepeda Navratil ,  Jason Scott ,  Adam Benjamin Smith-Kipnis ,  Brian Mount ,  John Bevis ,  Cameron Brown ,  Tony Ambrus ,  Phillip Charles Heckinger ,  Dan Kroymann ,  Matthew G. Kaplan ,  Aaron Krauss

发明人： Michael Scavezze ,  Nicholas Gervase Fajt ,  Arnulfo Zepeda Navratil ,  Jason Scott ,  Adam Benjamin Smith-Kipnis ,  Brian Mount ,  John Bevis ,  Cameron Brown ,  Tony Ambrus ,  Phillip Charles Heckinger ,  Dan Kroymann ,  Matthew G. Kaplan ,  Aaron Krauss

IPC分类号： G06T19/00

CPC分类号： G06T19/006 ,  G02B27/0093 ,  G02B27/017 ,  G06F3/011 ,  G06F3/012 ,  G06F3/013 ,  G06F3/0346 ,  G06F3/04815

摘要： Embodiments that relate to providing motion amplification to a virtual environment are disclosed. For example, in one disclosed embodiment a mixed reality augmentation program receives from a head-mounted display device motion data that corresponds to motion of a user in a physical environment. The program presents via the display device the virtual environment in motion in a principal direction, with the principal direction motion being amplified by a first multiplier as compared to the motion of the user in a corresponding principal direction. The program also presents the virtual environment in motion in a secondary direction, where the secondary direction motion is amplified by a second multiplier as compared to the motion of the user in a corresponding secondary direction, and the second multiplier is less than the first multiplier.

摘要翻译： 公开了向虚拟环境提供运动放大的实施例。 例如，在一个所公开的实施例中，混合现实增强程序从头戴式显示设备接收与物理环境中的用户的运动相对应的运动数据。 该程序通过显示装置在主方向上呈现运动中的虚拟环境，与主要方向上的用户的运动相比，主方向运动被第一乘法器放大。 程序还呈现在辅助方向上运动的虚拟环境，其中次要方向运动与第二乘法器相比，在相对次要方向上与用户的运动相比较，第二乘法器小于第一乘法器。