公开(公告)号：US10394034B2

公开(公告)日：2019-08-27

申请号：US15677999

申请日：2017-08-15

Applicant: Microsoft Technology Licensing, LLC

Inventor： Dmitry Reshidko ,  Ian Anh Nguyen ,  Richard Andrew Wall

IPC: G02B27/01 ,  G06K9/00 ,  G06F3/01 ,  G02B26/08 ,  G02B26/10 ,  G02B27/12 ,  G02B5/04 ,  G02B27/00

Abstract: An eye-tracking system is provided that includes a light source configured to emit at least infrared (IR) light and a microelectromechanical system (MEMS) scanning mirror configured to direct the IR light. The system further includes a relay including at least one prism, and the relay is configured to receive the IR light directed by the MEMS scanning mirror and redirect the IR light. The system further includes a waveguide through which the IR light redirected by the relay passes to reach an eye, and at least one sensor configured to receive the IR light after being reflected by the eye.

公开(公告)号：US12244977B2

公开(公告)日：2025-03-04

申请号：US17584976

申请日：2022-01-26

Applicant: Microsoft Technology Licensing, LLC.

Inventor： Parry Byron Johnson ,  Dmitriy Churin ,  Dmitry Reshidko

IPC: H04N9/31

Abstract: A projection system includes an illumination light source configured to emit an illumination light beam, a monitor light source configured to emit a monitor light beam, and a projector configured to project both the illumination light beam and the monitor light beam into a projected combined light beam. A first portion of the projected combined light beam is propagated over a first beam path in a first direction, causing an eye of a user to see a display image. A second portion of the projected combined light beam is propagated over a second beam path in a second direction, causing a monitor camera to capture a monitor image. The monitor image is analyzed to determine an orientation or a position of the monitor image. In response to determining that the monitor image is not properly oriented or positioned, an orientation or position of the projector or the illumination image is adjusted.

公开(公告)号：US12242667B2

公开(公告)日：2025-03-04

申请号：US18480181

申请日：2023-10-03

Applicant: Microsoft Technology Licensing, LLC

Inventor： Curtis Alan Tesdahl ,  Benjamin Eliot Lundell ,  David Rohn ,  Dmitry Reshidko ,  Dmitriy Churin ,  Kevin James Matherson ,  Sayyed Jaffar Ali Raza

IPC: G06F3/01 ,  G02B27/00 ,  G02B27/01 ,  G06N3/084 ,  G06V10/82 ,  G06V40/10 ,  G06V40/18

Abstract: Eye and hand tracking systems in head-mounted display (HMD) devices are arranged with lensless camera systems using optical masks as encoding elements that apply convolutions to optical images of body parts (e.g., eyes or hands) of HMD device users. The convolved body images are scrambled or coded representations that are captured by a sensor in the system, but are not human-recognizable. A machine learning system such as a neural network is configured to extract body features directly from the coded representation without performance of deconvolutions conventionally utilized to reconstruct the original body images in human-recognizable form. The extracted body features are utilized by the respective eye or hand tracking systems to output relevant tracking data for the user's eyes or hands which may be utilized by the HMD device to support various applications and user experiences. The lensless camera and machine learning system are jointly optimizable on an end-to-end basis.

公开(公告)号：US11953686B2

公开(公告)日：2024-04-09

申请号：US17448890

申请日：2021-09-26

Applicant: Microsoft Technology Licensing, LLC

Inventor： Robert Thomas Held ,  Bernard Charles Kress ,  Ashley Saulsbury ,  Dmitry Reshidko

IPC: G02B27/01 ,  G02B27/28 ,  G02F1/29 ,  G09G3/00

CPC classification number: G02B27/0172 ,  G02B27/0179 ,  G02B27/288 ,  G02F1/294 ,  G09G3/001 ,  G02B2027/0127 ,  G02B2027/0178 ,  G02B2027/0187

Abstract: An optical combiner in a display system of a mixed-reality head-mounted display (HMD) device comprises a lens of birefringent material and a ferroelectric liquid crystal (FLC) modulator that are adapted for use with a reflective waveguide to provide multiple different focal planes on which holograms of virtual-world objects (i.e., virtual images) are displayed. The birefringent lens has two orthogonal refractive indices, ordinary and extraordinary, depending on the polarization state of the incident light. Depending on the rotation of the polarization axis by the FLC modulator, the incoming light to the birefringent lens is focused either at a distance corresponding to the ordinary refractive index or the extraordinary refractive index. Virtual image light leaving the birefringent lens is in-coupled to a see-through reflective waveguide which is configured to form an exit pupil for the optical combiner to enable an HMD device user to view the virtual images from the source.

公开(公告)号：US10551616B2

公开(公告)日：2020-02-04

申请号：US15374490

申请日：2016-12-09

Applicant: Microsoft Technology Licensing, LLC

Inventor： R. Andrew Wall ,  Dmitry Reshidko

IPC: G02B27/00 ,  F21V8/00 ,  G02B27/10 ,  G02B27/01 ,  G02B27/30

Abstract: A display device system includes a display engine and optical waveguide. The display engine includes an image former, that produces light corresponding to an image, and one or more lens groups that collimate the light corresponding to the image and outputs the light from the display engine. Each lens group includes one or more lenses that share a mechanical axis. The light corresponding to the image produced by the image former has an optical axis ray coincident with a principal ray of the light that originates at a center of the image produced by the image former. At least one lens group has its mechanical axis tilted relative to the optical axis ray of the light corresponding to the image produced by the image former, to prevent a ghost image from being formed by light corresponding to the image that is reflected-back from the waveguide toward the display engine.

公开(公告)号：US20180157042A1

公开(公告)日：2018-06-07

申请号：US15370897

申请日：2016-12-06

Applicant: Microsoft Technology Licensing, LLC

Inventor： R. Andrew Wall ,  Dmitry Reshidko

IPC: G02B27/01 ,  F21V8/00 ,  G02B27/00

CPC classification number: G02B27/0172 ,  G02B6/002 ,  G02B6/0035 ,  G02B27/0081 ,  G02B2027/0125 ,  G02B2027/0178

Abstract: An apparatus, for use in replicating an image associated with an input-pupil to an output-pupil, comprises an optical waveguide including a bulk-substrate, an input-coupler and an output-coupler. The bulk-substrate includes first and second major sides and peripheral sides. The input-coupler couples, into the waveguide, light corresponding to the image associated with the input-pupil. The output-coupler couples, out of the waveguide, light corresponding to the image that has traveled through the waveguide from the input-coupler to the output-coupler at least in part by way of TIR. At least one of the peripheral sides includes first and second surfaces that define first and second planes angled 45 degrees relative to one another. Such a peripheral side provides for effective recycling of light that would otherwise leak out of the waveguide through the peripheral side.

公开(公告)号：US11876952B2

公开(公告)日：2024-01-16

申请号：US17648794

申请日：2022-01-24

Applicant: Microsoft Technology Licensing, LLC

Inventor： Dmitriy Churin ,  Parry Byron Johnson ,  Dmitry Reshidko ,  Congshan Wan

IPC: H04N13/327 ,  H04N13/344 ,  H04N13/341 ,  H04N13/363 ,  H04N13/398 ,  G02B27/01

CPC classification number: H04N13/327 ,  G02B27/0172 ,  H04N13/341 ,  H04N13/344 ,  H04N13/363 ,  H04N13/398 ,  G02B2027/0134 ,  G02B2027/0178

Abstract: Examples are disclosed that relate to calibration of a stereoscopic display system of an HMD via an optical calibration system comprising a waveguide combiner. One example provides an HMD device comprising a first image projector and a second image projector configured to project a stereoscopic image pair, and an optical calibration system. The optical calibration system comprises a first optical path indicative of an alignment of the first image projector, a second optical path indicative of an alignment of the second image projector, a waveguide combiner in which the first and second optical paths combine into a shared optical path, and one or more boresight sensors configured to detect calibration image light traveling along one or more of the first optical or the second optical path.

公开(公告)号：US11803238B1

公开(公告)日：2023-10-31

申请号：US17832424

申请日：2022-06-03

Applicant: Microsoft Technology Licensing, LLC

Inventor： Curtis Alan Tesdahl ,  Benjamin Eliot Lundell ,  David Rohn ,  Dmitry Reshidko ,  Dmitriy Churin ,  Kevin James Matherson ,  Sayyed Jaffar Ali Raza

IPC: G06F3/01 ,  G02B27/00 ,  G06N3/084 ,  G06V40/10 ,  G06V40/18 ,  G06V10/82 ,  G02B27/01

CPC classification number: G06F3/013 ,  G02B27/0093 ,  G02B27/0101 ,  G02B27/017 ,  G06N3/084 ,  G06V10/82 ,  G06V40/11 ,  G06V40/193 ,  G02B2027/014 ,  G02B2027/0138

Abstract: Eye and hand tracking systems in head-mounted display (HMD) devices are arranged with lensless camera systems using optical masks as encoding elements that apply convolutions to optical images of body parts (e.g., eyes or hands) of HMD device users. The convolved body images are scrambled or coded representations that are captured by a sensor in the system, but are not human-recognizable. A machine learning system such as a neural network is configured to extract body features directly from the coded representation without performance of deconvolutions conventionally utilized to reconstruct the original body images in human-recognizable form. The extracted body features are utilized by the respective eye or hand tracking systems to output relevant tracking data for the user's eyes or hands which may be utilized by the HMD device to support various applications and user experiences. The lensless camera and machine learning system are jointly optimizable on an end-to-end basis.

公开(公告)号：US11693248B1

公开(公告)日：2023-07-04

申请号：US17580421

申请日：2022-01-20

Applicant: Microsoft Technology Licensing, LLC

Inventor： Ishan Chatterjee ,  Dmitry Reshidko ,  Bernard Charles Kress

IPC: G02B27/01 ,  F21V8/00 ,  G02F1/1362

CPC classification number: G02B27/0172 ,  G02B6/005 ,  G02B6/0073 ,  G02F1/136277

Abstract: A display engine adapted for use in a head-mounted display (HMD) device includes a reflective liquid crystal on silicon (LCoS) spatial light modulator (SLM) that is illuminated using a backlight illumination module and a pair of optical prisms providing a total internal reflection (TIR) function. In an illustrative mixed-reality embodiment, the TIR prism pair guides light to the LCoS SLM from the backlight illumination module and projects virtual images reflected from the LCoS SLM, through projection optics, to a diffractive waveguide combiner for viewing by an HMD user.

公开(公告)号：US20190155021A1

公开(公告)日：2019-05-23

申请号：US15816770

申请日：2017-11-17

Applicant: Microsoft Technology Licensing, LLC

Inventor： Richard A. Wall ,  Dmitry Reshidko ,  Joseph Lowney ,  Richard A. James ,  Steven J. Robbins

IPC: G02B26/12 ,  G02B26/08 ,  G02B26/10 ,  H04N3/08 ,  G02B27/01 ,  G02B27/00

Abstract: Devices, systems, and methods corresponding to addressing misalignment in display systems are provided. A method includes using a first microelectromechanical system (MEMS) mirror, directing a first signal from a first light source to an alignment tracking waveguide. The method further includes receiving by a first photosensor a first portion of the first signal via the alignment tracking waveguide and determining a first alignment indicator associated with the first portion of the first signal. The method further includes using a second MEMS mirror, directing a second signal from a second light source to the alignment tracking waveguide. The method further includes receiving by a second photosensor a second portion of the second signal via the alignment tracking waveguide and determining a second alignment indicator associated with the second portion of the second signal.