公开(公告)号：US09761057B2

公开(公告)日：2017-09-12

申请号：US15357826

申请日：2016-11-21

Applicant: Microsoft Technology Licensing, LLC

Inventor： Thomas George Salter ,  Ben Sugden ,  Daniel Deptford ,  Robert Crocco, Jr. ,  Brian Keane ,  Laura Massey ,  Alex Kipman ,  Peter Tobias Kinnebrew ,  Nicholas Kamuda ,  Zachary Quarles ,  Michael Scavezze ,  Ryan Hastings ,  Cameron Brown ,  Tony Ambrus ,  Jason Scott ,  John Bevis ,  Jamie B. Kirschenbaum ,  Nicholas Gervase Fajt ,  Michael Klucher ,  Relja Markovic ,  Stephen Latta ,  Daniel McCulloch

IPC: G09G5/00 ,  G06T19/00 ,  G06T13/20 ,  G06F3/01 ,  G02B27/01 ,  G06F3/0481 ,  G06F3/16

CPC classification number: G06T19/006 ,  G02B27/0172 ,  G02B2027/0178 ,  G06F3/011 ,  G06F3/013 ,  G06F3/017 ,  G06F3/04815 ,  G06F3/167 ,  G06T13/20

Abstract: Embodiments are disclosed that relate to operating a user interface on an augmented reality computing device comprising a see-through display system. For example, one disclosed embodiment includes identifying one or more objects located outside a field of view of a user, and for each object of the one or more objects, providing to the user an indication of positional information associated with the object.

公开(公告)号：US20170069143A1

公开(公告)日：2017-03-09

申请号：US15357826

申请日：2016-11-21

Applicant: Microsoft Technology Licensing, LLC

Inventor： Thomas George Salter ,  Ben Sugden ,  Daniel Deptford ,  Robert Crocco, JR. ,  Brian Keane ,  Laura Massey ,  Alex Kipman ,  Peter Tobias Kinnebrew ,  Nicholas Kamuda ,  Zachary Quarles ,  Michael Scavezze ,  Ryan Hastings ,  Cameron Brown ,  Tony Ambrus ,  Jason Scott ,  John Bevis ,  Jamie B. Kirschenbaum ,  Nicholas Gervase Fajt ,  Michael Klucher ,  Relja Markovic ,  Stephen Latta ,  Daniel McCulloch

IPC: G06T19/00 ,  G06T13/20

CPC classification number: G06T19/006 ,  G02B27/0172 ,  G02B2027/0178 ,  G06F3/011 ,  G06F3/013 ,  G06F3/017 ,  G06F3/04815 ,  G06F3/167 ,  G06T13/20

Abstract: Embodiments are disclosed that relate to operating a user interface on an augmented reality computing device comprising a see-through display system. For example, one disclosed embodiment includes identifying one or more objects located outside a field of view of a user, and for each object of the one or more objects, providing to the user an indication of positional information associated with the object.

Abstract translation: 公开了涉及在包括透视显示系统的增强现实计算设备上操作用户界面的实施例。 例如，一个公开的实施例包括识别位于用户的视场之外的一个或多个对象，并且对于一个或多个对象的每个对象，向用户提供与对象相关联的位置信息的指示。

公开(公告)号：US11928856B2

公开(公告)日：2024-03-12

申请号：US17737911

申请日：2022-05-05

Applicant: Microsoft Technology Licensing, LLC

Inventor： Michael Ebstyne ,  Pedro Urbina Escos ,  Yuri Pekelny ,  Jonathan Chi Hang Chan ,  Emanuel Shalev ,  Alex Kipman ,  Mark Flick

IPC: G06V10/774 ,  G06F11/36 ,  G06F30/20 ,  G06F111/18 ,  G10L15/01 ,  G06F18/214

CPC classification number: G06V10/774 ,  G06F11/3684 ,  G06F30/20 ,  G10L15/01 ,  G06F18/214 ,  G06F2111/18

Abstract: A synthetic world interface may be used to model digital environments, sensors, and motions for the evaluation, development, and improvement of computer vision and speech algorithms. A synthetic data cloud service with a library of sensor primitives, motion generators, and environments with procedural and game-like capabilities, facilitates engineering design for a manufactural solution that has computer vision and speech capabilities. In some embodiments, a sensor platform simulator operates with a motion orchestrator, an environment orchestrator, an experiment generator, and an experiment runner to test various candidate hardware configurations and computer vision and speech algorithms in a virtual environment, advantageously speeding development and reducing cost. Thus, examples disclosed herein may relate to virtual reality (VR) or mixed reality (MR) implementations.

公开(公告)号：US11087176B2

公开(公告)日：2021-08-10

申请号：US15974665

申请日：2018-05-08

Applicant: Microsoft Technology Licensing, LLC

Inventor： Michael Ebstyne ,  Pedro Urbina Escos ,  Emanuel Shalev ,  Alex Kipman ,  Yuri Pekelny ,  Jonathan Chi Hang Chan

IPC: G06K9/62 ,  G06F30/20 ,  G06F111/18 ,  G06T7/70 ,  G06F11/36 ,  G06F11/26 ,  G06T19/00 ,  H04W4/02

Abstract: A synthetic world interface may be used to model digital environments, sensors, and motions for the evaluation, development, and improvement of localization algorithms. A synthetic data cloud service with a library of sensor primitives, motion generators, and environments with procedural and game-like capabilities, facilitates engineering design for a manufactural solution that has localization capabilities. In some embodiments, a sensor platform simulator operates with a motion orchestrator, an environment orchestrator, an experiment generator, and an experiment runner to test various candidate hardware configurations and localization algorithms in a virtual environment, advantageously speeding development and reducing cost. Thus, examples disclosed herein may relate to virtual reality (VR) or mixed reality (MR) implementations.

公开(公告)号：US10169922B2

公开(公告)日：2019-01-01

申请号：US15331746

申请日：2016-10-21

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Alex Kipman ,  Purnima M. Rao ,  Rebecca Haruyama ,  Shih-Sang Carnaven Chiu ,  Stuart Mayhew ,  Oscar E. Murillo ,  Carlos Fernando Faria Costa

IPC: G09G5/00 ,  G06T19/00 ,  G02B27/01 ,  G06F3/01 ,  G06F3/041 ,  G06F3/16 ,  G06F3/0488 ,  G06F1/16 ,  G06F3/03 ,  G06F3/0362 ,  G06F3/0484

Abstract: A mixed-reality display device comprises an input system, a display, and a graphics processor. The input system is configured to receive a parameter value, the parameter value being one of a plurality of values of a predetermined range receivable by the input system. The display is configured to display virtual image content that adds an augmentation to a real-world environment viewed by a user of the mixed-reality display device. The graphics processor is coupled operatively to the input system and to the display; it is configured to render the virtual image content so as to variably change the augmentation, to variably change a perceived realism of the real world environment in correlation to the parameter value.

公开(公告)号：US20170178412A1

公开(公告)日：2017-06-22

申请号：US15452378

申请日：2017-03-07

Applicant: Microsoft Technology Licensing, LLC

Inventor： Thomas George Salter ,  Ben Sugden ,  Daniel Deptford ,  Robert Crocco, JR. ,  Brian Keane ,  Laura Massey ,  Alex Kipman ,  Peter Tobias Kinnebrew ,  Nicholas Kamuda

IPC: G06T19/00 ,  G02B27/01 ,  G06F3/0481 ,  G06F3/01 ,  G06F3/0346

CPC classification number: G06T19/006 ,  G02B27/0093 ,  G02B27/017 ,  G02B27/0172 ,  G02B27/0179 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0178 ,  G06F3/011 ,  G06F3/0346 ,  G06F3/04815

Abstract: Embodiments that relate to presenting a plurality of visual information density levels for a plurality of geo-located data items in a mixed reality environment are disclosed. For example, in one disclosed embodiment a graduated information delivery program receives information for a first geo-located data item and provides a first visual information density level for the item to a head-mounted display device. When a spatial information density of geo-located data item information is below a threshold, the program provides a second visual information density level greater than the first level for a second geo-located data item displayed.

公开(公告)号：US09619939B2

公开(公告)日：2017-04-11

申请号：US13956231

申请日：2013-07-31

Applicant: Microsoft Technology Licensing, LLC

Inventor： Thomas George Salter ,  Ben Sugden ,  Daniel Deptford ,  Robert Crocco, Jr. ,  Brian Keane ,  Laura Massey ,  Alex Kipman ,  Peter Tobias Kinnebrew ,  Nicholas Kamuda

IPC: G06T19/00 ,  G02B27/01 ,  G06F3/01 ,  G06F3/0481 ,  G06F3/0346 ,  G02B27/00

CPC classification number: G06T19/006 ,  G02B27/0093 ,  G02B27/017 ,  G02B27/0172 ,  G02B27/0179 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0178 ,  G06F3/011 ,  G06F3/0346 ,  G06F3/04815

Abstract: Embodiments that relate to presenting a plurality of visual information density levels for a plurality of geo-located data items in a mixed reality environment are disclosed. For example, in one disclosed embodiment a graduated information delivery program receives information for a selected geo-located data item and provides a minimum visual information density level for the item to a head-mounted display device. The program receives via the head-mounted display device a user input corresponding to the selected geo-located data item. Based on the input, the program provides an increasing visual information density level for the selected item to the head-mounted display device for display within the mixed reality environment.

公开(公告)号：US20160171779A1

公开(公告)日：2016-06-16

申请号：US15043291

申请日：2016-02-12

Applicant: Microsoft Technology Licensing, LLC

Inventor： Avi Bar-Zeev ,  Bob Crocco ,  Alex Kipman ,  John Lewis

IPC: G06T19/00 ,  G02B27/01

CPC classification number: G06T19/006 ,  G02B26/026 ,  G02B27/017 ,  G02B27/0172 ,  G02B2027/0118 ,  G02B2027/0178 ,  G02B2027/0187

Abstract: An optical see-through head-mounted display device includes a see-through lens which combines an augmented reality image with light from a real-world scene, while an opacity filter is used to selectively block portions of the real-world scene so that the augmented reality image appears more distinctly. The opacity filter can be a see-through LCD panel, for instance, where each pixel of the LCD panel can be selectively controlled to be transmissive or opaque, based on a size, shape and position of the augmented reality image. Eye tracking can be used to adjust the position of the augmented reality image and the opaque pixels. Peripheral regions of the opacity filter, which are not behind the augmented reality image, can be activated to provide a peripheral cue or a representation of the augmented reality image. In another aspect, opaque pixels are provided at a time when an augmented reality image is not present.

公开(公告)号：US10573085B2

公开(公告)日：2020-02-25

申请号：US16195406

申请日：2018-11-19

Applicant: Microsoft Technology Licensing, LLC

Inventor： Alex Kipman ,  Purnima M. Rao ,  Rebecca Haruyama ,  Shih-Sang Carnaven Chiu ,  Stuart Mayhew ,  Oscar E. Murillo ,  Carlos Fernando Faria Costa

IPC: G06T19/00 ,  G06F3/0488 ,  G06F1/16 ,  G06F3/01 ,  G06F3/03 ,  G06F3/0362 ,  G06F3/0484 ,  G02B27/01 ,  G06F3/041 ,  G06F3/16

Abstract: A mixed-reality display device comprises an input system, a display, and a graphics processor. The input system is configured to receive a parameter value, the parameter value being one of a plurality of values of a predetermined range receivable by the input system. The display is configured to display virtual image content that adds an augmentation to a real-world environment viewed by a user of the mixed-reality display device. The graphics processor is coupled operatively to the input system and to the display; it is configured to render the virtual image content so as to variably change the augmentation, to variably change a perceived realism of the real world environment in correlation to the parameter value.

公开(公告)号：US09977492B2

公开(公告)日：2018-05-22

申请号：US13706814

申请日：2012-12-06

Applicant: Microsoft Technology Licensing, LLC

Inventor： Peter Tobias Kinnebrew ,  Alex Kipman

IPC: G06T19/00 ,  G06F3/01 ,  G06F3/0482

CPC classification number: G06F3/011 ,  G06F3/012 ,  G06F3/013 ,  G06F3/017 ,  G06F3/0482

Abstract: Embodiments that relate to presenting a mixed reality environment via a mixed reality display device are disclosed. For example, one disclosed embodiment provides a method for presenting a mixed reality environment via a head-mounted display device. The method includes using head pose data to generally identify one or more gross selectable targets within a sub-region of a spatial region occupied by the mixed reality environment. The method further includes specifically identifying a fine selectable target from among the gross selectable targets based on eye-tracking data. Gesture data is then used to identify a gesture, and an operation associated with the identified gesture is performed on the fine selectable target.