公开(公告)号：US20170004655A1

公开(公告)日：2017-01-05

申请号：US15262973

申请日：2016-09-12

Applicant: Microsoft Technology Licensing, LLC

Inventor： Michael Scavezze ,  Jonathan Steed ,  Stephen Latta ,  Kevin Geisner ,  Daniel McCulloch ,  Brian Mount ,  Ryan Hastings ,  Phillip Charles Heckinger

IPC: G06T19/00 ,  G02B27/00 ,  G06K9/62 ,  G02B27/01 ,  G06F3/01 ,  G06T19/20

CPC classification number: G06T19/006 ,  G02B27/0093 ,  G02B27/0172 ,  G02B2027/0138 ,  G02B2027/014 ,  G06F3/011 ,  G06K9/6267 ,  G06T19/20

Abstract: Embodiments that relate to interacting with a physical object in a mixed reality environment via a head-mounted display are disclosed. In one embodiment a mixed reality interaction program identifies an object based on an image from captured by the display. An interaction context for the object is determined based on an aspect of the mixed reality environment. A profile for the physical object is queried to determine interaction modes for the object. A selected interaction mode is programmatically selected based on the interaction context. A user input directed at the object is received via the display and interpreted to correspond to a virtual action based on the selected interaction mode. The virtual action is executed with respect to a virtual object associated with the physical object to modify an appearance of the virtual object. The modified virtual object is then displayed via the display.

Abstract translation: 公开了通过头戴式显示器与混合现实环境中的物理对象相互作用的实施例。 在一个实施例中，混合现实交互程序基于由显示器捕获的图像识别对象。 基于混合现实环境的一个方面确定对象的交互上下文。 查询物理对象的配置文件，以确定对象的交互模式。 基于交互上下文以编程方式选择选择的交互模式。 通过显示器接收指向对象的用户输入，并且基于所选择的交互模式将其解释为对应于虚拟动作。 相对于与物理对象相关联的虚拟对象执行虚拟动作以修改虚拟对象的外观。 然后通过显示器显示修改的虚拟对象。

公开(公告)号：US20150332513A1

公开(公告)日：2015-11-19

申请号：US14805727

申请日：2015-07-22

Applicant: Microsoft Technology Licensing, LLC

Inventor： Mike Scavezze ,  Jason Scott ,  Jonathan Steed ,  Ian McIntyre ,  Aaron Krauss ,  Daniel McCulloch ,  Stephen Latta

IPC: G06T19/00 ,  G02B27/01

CPC classification number: G06T19/006 ,  G02B27/0172 ,  G02B2027/0178

Abstract: Embodiments are disclosed that relate to augmenting an appearance of a surface via a see-through display device. For example, one disclosed embodiment provides, on a computing device comprising a see-through display device, a method of augmenting an appearance of a surface. The method includes acquiring, via an outward-facing image sensor, image data of a first scene viewable through the display. The method further includes recognizing a surface viewable through the display based on the image data and, in response to recognizing the surface, acquiring a representation of a second scene comprising one or more of a scene located physically behind the surface viewable through the display and a scene located behind a surface contextually related to the surface viewable through the display. The method further includes displaying the representation via the see-through display.

Abstract translation: 公开了涉及通过透视显示装置增强表面的外观的实施例。 例如，一个公开的实施例在包括透视显示装置的计算装置上提供增加表面外观的方法。 该方法包括通过面向外的图像传感器获取可通过显示器观看的第一场景的图像数据。 该方法还包括基于图像数据识别通过显示器可视的表面，并且响应于识别表面，获取第二场景的表示，该第二场景包括物理地位于通过显示器可观看的表面之后的场景中的一个或多个，以及 位于与表面相关的表面后面的场景，可通过显示屏观看。 该方法还包括经由透视显示器显示表示。

公开(公告)号：US20150324562A1

公开(公告)日：2015-11-12

申请号：US14805685

申请日：2015-07-22

Applicant: Microsoft Technology Licensing, LLC

Inventor： Mike Scavezze ,  Jason Scott ,  Jonathan Steed ,  Ian McIntyre ,  Aaron Krauss ,  Daniel McCulloch ,  Stephen Latta ,  Kevin Geisner ,  Brian Mount

IPC: G06F21/31 ,  G06F3/01 ,  G10L15/22

CPC classification number: G06F21/31 ,  G06F3/013 ,  G06F21/34 ,  G06F21/36 ,  G10L15/22 ,  H04L63/08 ,  H04W12/06

Abstract: Embodiments are disclosed that relate to authenticating a user of a display device. For example, one disclosed embodiment includes displaying one or more virtual images on the display device, wherein the one or more virtual images include a set of augmented reality features. The method further includes identifying one or more movements of the user via data received from a sensor of the display device, and comparing the identified movements of the user to a predefined set of authentication information for the user that links user authentication to a predefined order of the augmented reality features. If the identified movements indicate that the user selected the augmented reality features in the predefined order, then the user is authenticated, and if the identified movements indicate that the user did not select the augmented reality features in the predefined order, then the user is not authenticated.

Abstract translation: 公开了涉及认证显示设备的用户的实施例。 例如，一个公开的实施例包括在显示设备上显示一个或多个虚拟图像，其中一个或多个虚拟图像包括一组增强现实特征。 所述方法还包括通过从所述显示设备的传感器接收的数据来识别所述用户的一个或多个移动，以及将所识别的用户移动与所述用户认证信息的预定义集合进行比较，所述用户认证信息将用户认证链接到 增强的现实功能。 如果所识别的移动指示用户以预定义的顺序选择增强的现实特征，则用户被认证，并且如果所识别的移动指示用户没有以预定义的顺序选择增强的真实特征，则用户不是 认证。

公开(公告)号：US20150130689A1

公开(公告)日：2015-05-14

申请号：US14602746

申请日：2015-01-22

Applicant: Microsoft Technology Licensing, LLC

Inventor： Ben Sugden ,  John Clavin ,  Ben Vaught ,  Stephen Latta ,  Kathryn Stone Perez ,  Daniel McCulloch ,  Jason Scott ,  Wei Zhang ,  Darren Bennett ,  Ryan Hastings ,  Arthur Tomlin ,  Kevin Geisner

IPC: G02B27/01

CPC classification number: G06T19/006 ,  G02B27/01 ,  G02B27/017 ,  G02B27/0172 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0141 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F3/011 ,  G06F3/013 ,  G06F3/017 ,  G06F3/1407 ,  G06F3/167 ,  G06F17/30241 ,  G06T7/12 ,  G06T7/194 ,  G06T7/215

Abstract: Embodiments for interacting with an executable virtual object associated with a real object are disclosed. In one example, a method for interacting with an executable virtual object associated with a real object includes receiving sensor input from one or more sensors attached to the portable see-through display device, and obtaining information regarding a location of the user based on the sensor input. The method also includes, if the location includes a real object comprising an associated executable virtual object, then determining an intent of the user to interact with the executable virtual object, and if the intent to interact is determined, then interacting with the executable object.

Abstract translation: 公开了与与真实对象相关联的可执行虚拟对象进行交互的实施例。 在一个示例中，用于与与真实对象相关联的可执行虚拟对象交互的方法包括从附接到便携式透视显示设备的一个或多个传感器接收传感器输入，以及基于传感器获得关于用户位置的信息 输入。 该方法还包括，如果位置包括包括相关联的可执行虚拟对象的真实对象，则确定用户与可执行虚拟对象交互的意图，并且如果确定了交互意图，则与可执行对象进行交互。