公开(公告)号：US10007349B2

公开(公告)日：2018-06-26

申请号：US14703789

申请日：2015-05-04

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Stephen G. Latta ,  Brian J. Mount ,  Adam G. Poulos ,  Jeffrey A. Kohler ,  Arthur C. Tomlin ,  Jonathan T. Steed

IPC: G09G5/00 ,  G06F3/033 ,  G06F3/01

CPC classification number: G06F3/017

Abstract: Methods for recognizing gestures using adaptive multi-sensor gesture recognition are described. In some embodiments, a gesture recognition system receives a plurality of sensor inputs from a plurality of sensor devices and a plurality of confidence thresholds associated with the plurality of sensor inputs. A confidence threshold specifies a minimum confidence value for which it is deemed that a particular gesture has occurred. Upon detection of a compensating event, such as excessive motion involving one of the plurality of sensor devices, the gesture recognition system may modify the plurality of confidence thresholds based on the compensating event. Subsequently, the gesture recognition system generates a multi-sensor confidence value based on whether at least a subset of the plurality of confidence thresholds has been satisfied. The gesture recognition system may also modify the plurality of confidence thresholds based on the plugging and unplugging of sensor inputs from the gesture recognition system.

公开(公告)号：US09779512B2

公开(公告)日：2017-10-03

申请号：US14609312

申请日：2015-01-29

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Arthur C. Tomlin ,  Roger Sebastian-Kevin Sylvan ,  Dan Kroymann ,  Cameron G. Brown ,  Nicholas Gervase Fajt

IPC: G09G5/02 ,  G06T7/40 ,  G06T15/04 ,  G06T19/00 ,  G02B27/01 ,  G06T5/00

CPC classification number: G06T7/40 ,  G02B27/017 ,  G02B27/0172 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0178 ,  G06T5/006 ,  G06T15/04 ,  G06T19/006

Abstract: Methods for automatically generating a texture exemplar that may be used for rendering virtual objects that appear to be made from the texture exemplar are described. In some embodiments, a head-mounted display device (HMD) may identify a real-world object within an environment, acquire a three-dimensional model of the real-world object, determine a portion of the real-world object from which a texture exemplar is to be generated, capture one or more images of the portion of the real-world object, determine an orientation of the real-world object, and generate the texture exemplar using the one or more images, the three-dimensional model, and the orientation of the real-world object. The HMD may then render and display images of a virtual object such that the virtual object appears to be made from a virtual material associated with the texture exemplar.

公开(公告)号：US09552060B2

公开(公告)日：2017-01-24

申请号：US14166778

申请日：2014-01-28

Applicant: Microsoft Technology Licensing, LLC

Inventor： Anthony J. Ambrus ,  Adam G. Poulos ,  Lewey Alec Geselowitz ,  Dan Kroymann ,  Arthur C. Tomlin ,  Roger Sebastian-Kevin Sylvan ,  Mathew J. Lamb ,  Brian J. Mount

IPC: G09G5/00 ,  G06F3/01 ,  G06F3/0484 ,  G06F3/0482

CPC classification number: G06F3/013 ,  G06F3/012 ,  G06F3/0482 ,  G06F3/04842

Abstract: Methods for enabling hands-free selection of objects within an augmented reality environment are described. In some embodiments, an object may be selected by an end user of a head-mounted display device (HMD) based on detecting a vestibulo-ocular reflex (VOR) with the end user's eyes while the end user is gazing at the object and performing a particular head movement for selecting the object. The object selected may comprise a real object or a virtual object. The end user may select the object by gazing at the object for a first time period and then performing a particular head movement in which the VOR is detected for one or both of the end user's eyes. In one embodiment, the particular head movement may involve the end user moving their head away from a direction of the object at a particular head speed while gazing at the object.

Abstract translation: 描述了在增强现实环境中实现免提选择对象的方法。 在一些实施例中，可以由头戴式显示装置（HMD）的最终用户基于在最终用户注视物体时检测与最终用户的眼睛的前庭眼反射（VOR）来选择对象并执行对象 用于选择对象的特定头部移动。 所选择的对象可以包括真实对象或虚拟对象。 最终用户可以通过在第一时间段内注视对象来选择对象，然后执行其中针对终端用户的眼睛中的一个或两个检测到VOR的特定头部移动。 在一个实施例中，特定头部移动可以涉及最终用户在注视物体时以其特定的头部速度将头部从物体的方向移开。

公开(公告)号：US20160343172A1

公开(公告)日：2016-11-24

申请号：US15227453

申请日：2016-08-03

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Oliver Michael Christian Williams ,  Paul Barham ,  Michael Isard ,  Tuan Wong ,  Kevin Woo ,  Georg Klein ,  Douglas Kevin Service ,  Ashraf Ayman Michail ,  Andrew Pearson ,  Martin Shetter ,  Jeffrey Neil Margolis ,  Nathan Ackerman ,  Calvin Chan ,  Arthur C. Tomlin

IPC: G06T19/00 ,  G06K9/66 ,  G02B27/01 ,  G09G3/3208 ,  G06T3/20 ,  G06F3/01 ,  G06T7/40 ,  G06K9/62

CPC classification number: G06T19/006 ,  G02B27/017 ,  G02B27/0172 ,  G02B27/0179 ,  G02B2027/014 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F3/012 ,  G06F3/013 ,  G06F3/04815 ,  G06K9/6215 ,  G06K9/66 ,  G06T3/20 ,  G09G3/3208 ,  G09G2300/04

Abstract: Methods for generating and displaying images associated with one or more virtual objects within an augmented reality environment at a frame rate that is greater than a rendering frame rate are described. The rendering frame rate may correspond with the minimum time to render images associated with a pose of a head-mounted display device (HMD). In some embodiments, the HMD may determine a predicted pose associated with a future position and orientation of the HMD, generate a pre-rendered image based on the predicted pose, determine an updated pose associated with the HMD subsequent to generating the pre-rendered image, generate an updated image based on the updated pose and the pre-rendered image, and display the updated image on the HMD. The updated image may be generated via a homographic transformation and/or a pixel offset adjustment of the pre-rendered image.

公开(公告)号：US09442567B2

公开(公告)日：2016-09-13

申请号：US14925796

申请日：2015-10-28

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Jason Scott ,  Arthur C. Tomlin ,  Mike Thomas ,  Matthew Kaplan ,  Cameron G. Brown ,  Jonathan Plumb ,  Nicholas Gervase Fajt ,  Daniel J. McCulloch ,  Jeremy Lee

IPC: G09G5/08 ,  G06F3/033 ,  G06F3/01 ,  G06F3/0484 ,  G06T11/60 ,  G02B27/01 ,  G06F3/03 ,  G06T19/00

CPC classification number: G06F3/013 ,  G02B27/017 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F3/012 ,  G06F3/017 ,  G06F3/0304 ,  G06F3/04842 ,  G06F3/04845 ,  G06T11/60 ,  G06T19/006

Abstract: Methods for enabling hands-free selection of virtual objects are described. In some embodiments, a gaze swipe gesture may be used to select a virtual object. The gaze swipe gesture may involve an end user of a head-mounted display device (HMD) performing head movements that are tracked by the HMD to detect whether a virtual pointer controlled by the end user has swiped across two or more edges of the virtual object. In some cases, the gaze swipe gesture may comprise the end user using their head movements to move the virtual pointer through two edges of the virtual object while the end user gazes at the virtual object. In response to detecting the gaze swipe gesture, the HMD may determine a second virtual object to be displayed on the HMD based on a speed of the gaze swipe gesture and a size of the virtual object.