公开(公告)号：US12244977B2

公开(公告)日：2025-03-04

申请号：US17584976

申请日：2022-01-26

Applicant: Microsoft Technology Licensing, LLC.

Inventor： Parry Byron Johnson ,  Dmitriy Churin ,  Dmitry Reshidko

IPC: H04N9/31

Abstract: A projection system includes an illumination light source configured to emit an illumination light beam, a monitor light source configured to emit a monitor light beam, and a projector configured to project both the illumination light beam and the monitor light beam into a projected combined light beam. A first portion of the projected combined light beam is propagated over a first beam path in a first direction, causing an eye of a user to see a display image. A second portion of the projected combined light beam is propagated over a second beam path in a second direction, causing a monitor camera to capture a monitor image. The monitor image is analyzed to determine an orientation or a position of the monitor image. In response to determining that the monitor image is not properly oriented or positioned, an orientation or position of the projector or the illumination image is adjusted.

公开(公告)号：US12242667B2

公开(公告)日：2025-03-04

申请号：US18480181

申请日：2023-10-03

Applicant: Microsoft Technology Licensing, LLC

Inventor： Curtis Alan Tesdahl ,  Benjamin Eliot Lundell ,  David Rohn ,  Dmitry Reshidko ,  Dmitriy Churin ,  Kevin James Matherson ,  Sayyed Jaffar Ali Raza

IPC: G06F3/01 ,  G02B27/00 ,  G02B27/01 ,  G06N3/084 ,  G06V10/82 ,  G06V40/10 ,  G06V40/18

Abstract: Eye and hand tracking systems in head-mounted display (HMD) devices are arranged with lensless camera systems using optical masks as encoding elements that apply convolutions to optical images of body parts (e.g., eyes or hands) of HMD device users. The convolved body images are scrambled or coded representations that are captured by a sensor in the system, but are not human-recognizable. A machine learning system such as a neural network is configured to extract body features directly from the coded representation without performance of deconvolutions conventionally utilized to reconstruct the original body images in human-recognizable form. The extracted body features are utilized by the respective eye or hand tracking systems to output relevant tracking data for the user's eyes or hands which may be utilized by the HMD device to support various applications and user experiences. The lensless camera and machine learning system are jointly optimizable on an end-to-end basis.

公开(公告)号：US11876952B2

公开(公告)日：2024-01-16

申请号：US17648794

申请日：2022-01-24

Applicant: Microsoft Technology Licensing, LLC

Inventor： Dmitriy Churin ,  Parry Byron Johnson ,  Dmitry Reshidko ,  Congshan Wan

IPC: H04N13/327 ,  H04N13/344 ,  H04N13/341 ,  H04N13/363 ,  H04N13/398 ,  G02B27/01

CPC classification number: H04N13/327 ,  G02B27/0172 ,  H04N13/341 ,  H04N13/344 ,  H04N13/363 ,  H04N13/398 ,  G02B2027/0134 ,  G02B2027/0178

Abstract: Examples are disclosed that relate to calibration of a stereoscopic display system of an HMD via an optical calibration system comprising a waveguide combiner. One example provides an HMD device comprising a first image projector and a second image projector configured to project a stereoscopic image pair, and an optical calibration system. The optical calibration system comprises a first optical path indicative of an alignment of the first image projector, a second optical path indicative of an alignment of the second image projector, a waveguide combiner in which the first and second optical paths combine into a shared optical path, and one or more boresight sensors configured to detect calibration image light traveling along one or more of the first optical or the second optical path.

公开(公告)号：US11803238B1

公开(公告)日：2023-10-31

申请号：US17832424

申请日：2022-06-03

Applicant: Microsoft Technology Licensing, LLC

Inventor： Curtis Alan Tesdahl ,  Benjamin Eliot Lundell ,  David Rohn ,  Dmitry Reshidko ,  Dmitriy Churin ,  Kevin James Matherson ,  Sayyed Jaffar Ali Raza

IPC: G06F3/01 ,  G02B27/00 ,  G06N3/084 ,  G06V40/10 ,  G06V40/18 ,  G06V10/82 ,  G02B27/01

CPC classification number: G06F3/013 ,  G02B27/0093 ,  G02B27/0101 ,  G02B27/017 ,  G06N3/084 ,  G06V10/82 ,  G06V40/11 ,  G06V40/193 ,  G02B2027/014 ,  G02B2027/0138

Abstract: Eye and hand tracking systems in head-mounted display (HMD) devices are arranged with lensless camera systems using optical masks as encoding elements that apply convolutions to optical images of body parts (e.g., eyes or hands) of HMD device users. The convolved body images are scrambled or coded representations that are captured by a sensor in the system, but are not human-recognizable. A machine learning system such as a neural network is configured to extract body features directly from the coded representation without performance of deconvolutions conventionally utilized to reconstruct the original body images in human-recognizable form. The extracted body features are utilized by the respective eye or hand tracking systems to output relevant tracking data for the user's eyes or hands which may be utilized by the HMD device to support various applications and user experiences. The lensless camera and machine learning system are jointly optimizable on an end-to-end basis.

公开(公告)号：US11722654B1

公开(公告)日：2023-08-08

申请号：US17829325

申请日：2022-05-31

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Michael Scott Sutton ,  James P. Terrell, Jr. ,  Dmitriy Churin ,  Ishan Chatterjee ,  Rayna Demaster-Smith

IPC: H04N13/327 ,  G02B27/42 ,  H04N13/344 ,  H04N25/00 ,  H04N13/00

CPC classification number: H04N13/327 ,  G02B27/4233 ,  H04N13/344 ,  H04N25/00 ,  H04N2013/0081

Abstract: The techniques disclosed herein may be utilized to detect, measure, and/or compensate for misalignments of a display that may occur after manufacturing. A Talbot sensor is described that includes a diffraction device and an image sensor. Captured images from the image sensor include pixel data values that include bright and dark spots that represent a diffraction pattern associated with the Talbot sensor. A demodulator multiplies the pixel data values with sine and cosine reference images to generate averaged in-phase and quadrature values, which can be used to determine a phase angle for incident light on the Talbot sensor. Phase angle changes over time indicate changes in the alignment of the display, which may be corrected by display parameter manipulation. The resulting devices, systems and methods provide for portable solutions, with reduced cost of manufacturing, reduced part costs, and reduced complexity.