公开(公告)号：US10134192B2

公开(公告)日：2018-11-20

申请号：US15295791

申请日：2016-10-17

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Arthur Tomlin ,  Adam Gabriel Poulos ,  Cameron Graeme Brown

IPC: G06T19/00 ,  G06F1/14 ,  G06F3/03 ,  G02B27/01 ,  G06F3/01 ,  G06F3/0346 ,  G06T7/00 ,  A61B90/00

Abstract: Methods and systems for displaying a computer generated image corresponding to the pose of a real-world object in a mixed reality system. The system may include of a head-mounted display (HMD) device, a magnetic track system and an optical system. Pose data detected by the two tracking systems can be synchronized by a timestamp that is embedded in an electromagnetic field transmitted by the magnetic tracking system. A processor may also be configured to calculate a future pose of the real world object based on a time offset based on the time needed by the HMD to calculate, buffer and generate display output and on data from the two tracking systems, such that the relative location of the computer generated image (CGI) corresponds with the actual location of the real-world object relative to the real world environment at the time the CGI actually appears in the display.

公开(公告)号：US09874932B2

公开(公告)日：2018-01-23

申请号：US14682860

申请日：2015-04-09

Applicant: Microsoft Technology Licensing, LLC

Inventor： Matthew Calbraith Crisler ,  Robert Thomas Held ,  Stephen Latta ,  Ashraf Ayman Michail ,  Martin Shetter ,  Arthur Tomlin

IPC: G06F3/01 ,  G02B27/01 ,  H04N13/04

CPC classification number: G06F3/013 ,  G02B27/0093 ,  G02B27/017 ,  G02B27/0172 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0178 ,  G02B2027/0181 ,  G02B2027/0187 ,  G06F3/011 ,  G06F3/012 ,  G06F3/04815 ,  H04N13/324 ,  H04N13/344 ,  H04N13/363

Abstract: One embodiment provides a method to display video such as computer-rendered animation or other video. The method includes assembling a sequence of video frames featuring a moving object, each video frame including a plurality of subframes sequenced for display according to a schedule. The method also includes determining a vector-valued differential velocity of the moving object relative to a head of an observer of the video. At a time scheduled for display of a first subframe of a given frame, first-subframe image content transformed by a first transform is displayed. At a time scheduled for display of the second subframe of the given frame, second-subframe image content transformed by a second transform is displayed. The first and second transforms are computed based on the vector-valued differential velocity to mitigate artifacts.

公开(公告)号：US20170206668A1

公开(公告)日：2017-07-20

申请号：US15474687

申请日：2017-03-30

Applicant: Microsoft Technology Licensing, LLC

Inventor： Adam G. Poulos ,  Arthur Tomlin ,  Tony Ambrus ,  Jeffrey Cole ,  Ian Douglas McIntyre ,  Drew Steedly ,  Frederik Schaffalitzky ,  Georg Klein ,  Kathleen P. Mulcahy

IPC: G06T7/246 ,  G06T19/00 ,  G02B27/01 ,  G06T7/60

CPC classification number: G06T7/248 ,  G02B27/017 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0141 ,  G02B2027/0178 ,  G06F3/011 ,  G06F3/012 ,  G06F3/017 ,  G06F3/04815 ,  G06K9/00208 ,  G06K9/00624 ,  G06K9/00671 ,  G06K9/00791 ,  G06K9/00832 ,  G06K9/2018 ,  G06K9/4604 ,  G06K9/6215 ,  G06T7/20 ,  G06T7/60 ,  G06T19/006 ,  G06T2207/30252

Abstract: Embodiments are disclosed for methods and systems of distinguishing movements of features in a physical environment. For example, on a head-mounted display device, one embodiment of a method includes obtaining a representation of real-world features in two or more coordinate frames and obtaining motion data from one or more sensors external to the head-mounted display device. The method further includes distinguishing features in one coordinate frame from features in another coordinate frame based upon the motion data.

公开(公告)号：US20160077785A1

公开(公告)日：2016-03-17

申请号：US14951299

申请日：2015-11-24

Applicant: Microsoft Technology Licensing, LLC

Inventor： Ben Sugden ,  John Clavin ,  Ben Vaught ,  Stephen Latta ,  Kathryn Stone Perez ,  Daniel McCulloch ,  Jason Scott ,  Wei Zhang ,  Darren Bennett ,  Ryan Hastings ,  Arthur Tomlin ,  Kevin Geisner

IPC: G06F3/14 ,  G06F17/30 ,  G06T7/20 ,  G02B27/01 ,  G06F3/01 ,  G06F3/16

CPC classification number: G06T19/006 ,  G02B27/01 ,  G02B27/017 ,  G02B27/0172 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0141 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F3/011 ,  G06F3/013 ,  G06F3/017 ,  G06F3/1407 ,  G06F3/167 ,  G06F17/30241 ,  G06T7/12 ,  G06T7/194 ,  G06T7/215

Abstract: Embodiments for interacting with an executable virtual object associated with a real object are disclosed. In one example, a method for interacting with an executable virtual object associated with a real object includes receiving sensor input from one or more sensors attached to the portable see-through display device, and obtaining information regarding a location of the user based on the sensor input. The method also includes, if the location includes a real object comprising an associated executable virtual object, then determining an intent of the user to interact with the executable virtual object, and if the intent to interact is determined, then interacting with the executable object.

公开(公告)号：US20190379885A1

公开(公告)日：2019-12-12

申请号：US16379182

申请日：2019-04-09

Applicant: Microsoft Technology Licensing, LLC

Inventor： Michael Scavezze ,  Arthur Tomlin ,  Rui Cai ,  Zhiwei Li

IPC: H04N13/344 ,  H04N13/128 ,  G06T7/30 ,  G06T7/70 ,  G06T7/55 ,  H04N13/239 ,  G06T17/10

Abstract: Sensor fusion is utilized in an electronic device such as a head mounted display (HMD) device that has a sensor package equipped with different sensors so that information that is supplemental to captured 2D images of objects or scenes in a real world environment may be utilized to determine an optimized transform of image stereo-pairs and to discard erroneous data that would otherwise prevent successful scans used for construction of a 3D model in, for example, virtual world applications. Such supplemental information can include one or more of world location, world rotation, image data from an extended field of view (FOV), or depth map data.

公开(公告)号：US10268266B2

公开(公告)日：2019-04-23

申请号：US15197484

申请日：2016-06-29

Applicant: Microsoft Technology Licensing, LLC

Inventor： Cheyne Rory Quin Mathey-Owens ,  Arthur Tomlin ,  Marcus Ghaly

IPC: G06F3/01 ,  G06F3/0484 ,  G06F3/0481 ,  G06F3/0482 ,  G06T7/00 ,  G06T19/00

Abstract: A user may select or interact with objects in a scene using gaze tracking and movement tracking. In some examples, the scene may comprise a virtual reality scene or a mixed reality scene. A user may move an input object in an environment and be facing in a direction towards the movement of the input object. A computing device may use sensors to obtain movement data corresponding to the movement of the input object, and gaze tracking data including to a location of eyes of the user. One or more modules of the computing device may use the movement data and gaze tracking data to determine a three-dimensional selection space in the scene. In some examples, objects included in the three-dimensional selection space may be selected or otherwise interacted with.

公开(公告)号：US10229544B2

公开(公告)日：2019-03-12

申请号：US15815634

申请日：2017-11-16

Applicant: Microsoft Technology Licensing, LLC

Inventor： Jonathan Steed ,  Aaron Krauss ,  Mike Scavezze ,  Wei Zhang ,  Arthur Tomlin ,  Tony Ambrus ,  Brian Mount ,  Stephen Latta ,  Ryan Hastings

IPC: G06T19/00 ,  G06T15/50

Abstract: Embodiments related to efficiently constructing an augmented reality environment with global illumination effects are disclosed. For example, one disclosed embodiment provides a method of displaying an augmented reality image via a display device. The method includes receiving image data, the image data capturing an image of a local environment of the display device, and identifying a physical feature of the local environment via the image data. The method further includes constructing an augmented reality image of a virtual structure for display over the physical feature in spatial registration with the physical feature from a viewpoint of a user, the augmented reality image comprising a plurality of modular virtual structure segments arranged in adjacent locations to form the virtual structure feature, each modular virtual structure segment comprising a pre-computed global illumination effect, and outputting the augmented reality image to the display device.

公开(公告)号：US10223799B2

公开(公告)日：2019-03-05

申请号：US15474687

申请日：2017-03-30

Applicant: Microsoft Technology Licensing, LLC

Inventor： Adam G. Poulos ,  Arthur Tomlin ,  Tony Ambrus ,  Jeffrey Cole ,  Ian Douglas McIntyre ,  Drew Steedly ,  Frederik Schaffalitzky ,  Georg Klein ,  Kathleen P. Mulcahy

IPC: G02B27/01 ,  G06T19/00 ,  G06T7/246 ,  G06T7/60 ,  G06K9/62 ,  G06K9/46 ,  G06F3/01 ,  G06F3/0481 ,  G06K9/00 ,  G06T7/20 ,  G06K9/20

Abstract: Embodiments are disclosed for methods and systems of distinguishing movements of features in a physical environment. For example, on a head-mounted display device, one embodiment of a method includes obtaining a representation of real-world features in two or more coordinate frames and obtaining motion data from one or more sensors external to the head-mounted display device. The method further includes distinguishing features in one coordinate frame from features in another coordinate frame based upon the motion data.

公开(公告)号：US10083540B2

公开(公告)日：2018-09-25

申请号：US15412888

申请日：2017-01-23

Applicant: Microsoft Technology Licensing, LLC

Inventor： Ben Sugden ,  Darren Bennett ,  Brian Mount ,  Sebastian Sylvan ,  Arthur Tomlin ,  Ryan Hastings ,  Daniel McCulloch ,  Kevin Geisner ,  Robert Crocco, Jr.

IPC: G06T15/60 ,  G06T19/00 ,  G06T7/11 ,  G06T7/60 ,  G06T7/73 ,  G02B27/01

CPC classification number: G06T15/60 ,  G02B27/017 ,  G02B27/0172 ,  G02B2027/0112 ,  G02B2027/0118 ,  G02B2027/014 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F3/011 ,  G06F3/012 ,  G06F3/04815 ,  G06T7/11 ,  G06T7/60 ,  G06T7/73 ,  G06T19/006 ,  G06T2215/16

Abstract: A head-mounted display system includes a see-through display that is configured to visually augment an appearance of a physical environment to a user viewing the physical environment through the see-through display. Graphical content presented via the see-through display is created by modeling the ambient lighting conditions of the physical environment.

公开(公告)号：US20180075663A1

公开(公告)日：2018-03-15

申请号：US15815634

申请日：2017-11-16

Applicant: Microsoft Technology Licensing, LLC

Inventor： Jonathan Steed ,  Aaron Krauss ,  Mike Scavezze ,  Wei Zhang ,  Arthur Tomlin ,  Tony Ambrus ,  Brian Mount ,  Stephen Latta ,  Ryan Hastings

IPC: G06T19/00 ,  G06T15/50

CPC classification number: G06T19/006 ,  G06T15/50 ,  G06T2215/16

Abstract: Embodiments related to efficiently constructing an augmented reality environment with global illumination effects are disclosed. For example, one disclosed embodiment provides a method of displaying an augmented reality image via a display device. The method includes receiving image data, the image data capturing an image of a local environment of the display device, and identifying a physical feature of the local environment via the image data. The method further includes constructing an augmented reality image of a virtual structure for display over the physical feature in spatial registration with the physical feature from a viewpoint of a user, the augmented reality image comprising a plurality of modular virtual structure segments arranged in adjacent locations to form the virtual structure feature, each modular virtual structure segment comprising a pre-computed global illumination effect, and outputting the augmented reality image to the display device.