公开(公告)号：US11620761B2

公开(公告)日：2023-04-04

申请号：US17341218

申请日：2021-06-07

Applicant: Microsoft Technology Licensing, LLC

Inventor： Navid Poulad ,  Rayna Demaster-Smith

IPC: G06T7/593 ,  G06T7/40 ,  G06T7/11 ,  G06T7/80 ,  H04N13/239 ,  G06T17/00 ,  H04N9/04 ,  G06T15/04 ,  H04N13/344 ,  G02B27/01 ,  G06T7/521 ,  H04N13/00 ,  H04S7/00

Abstract: Examples are disclosed that relate to displaying a hologram via an HMD. One disclosed example provides a method comprising obtaining depth data from a direct-measurement depth sensor included in the case for the HMD, the depth data comprising a depth map of a real-world environment. The method further comprises determining a distance from the HMD to an object in the real-world environment using the depth map, obtaining holographic imagery for display based at least upon the distance, and outputting the holographic imagery for display on the HMD.

公开(公告)号：US11722654B1

公开(公告)日：2023-08-08

申请号：US17829325

申请日：2022-05-31

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Michael Scott Sutton ,  James P. Terrell, Jr. ,  Dmitriy Churin ,  Ishan Chatterjee ,  Rayna Demaster-Smith

IPC: H04N13/327 ,  G02B27/42 ,  H04N13/344 ,  H04N25/00 ,  H04N13/00

CPC classification number: H04N13/327 ,  G02B27/4233 ,  H04N13/344 ,  H04N25/00 ,  H04N2013/0081

Abstract: The techniques disclosed herein may be utilized to detect, measure, and/or compensate for misalignments of a display that may occur after manufacturing. A Talbot sensor is described that includes a diffraction device and an image sensor. Captured images from the image sensor include pixel data values that include bright and dark spots that represent a diffraction pattern associated with the Talbot sensor. A demodulator multiplies the pixel data values with sine and cosine reference images to generate averaged in-phase and quadrature values, which can be used to determine a phase angle for incident light on the Talbot sensor. Phase angle changes over time indicate changes in the alignment of the display, which may be corrected by display parameter manipulation. The resulting devices, systems and methods provide for portable solutions, with reduced cost of manufacturing, reduced part costs, and reduced complexity.

公开(公告)号：US11663739B2

公开(公告)日：2023-05-30

申请号：US17199241

申请日：2021-03-11

Applicant: Microsoft Technology Licensing, LLC

Inventor： Paulo Ricardo Dos Santos Mendonca ,  Christopher Charles Aholt ,  Christopher Maurice Mei ,  Rayna Demaster-Smith

IPC: G06T7/80 ,  G06T7/73 ,  B60R1/00 ,  G06F3/01

CPC classification number: G06T7/80 ,  B60R1/00 ,  G06F3/013 ,  G06T7/74 ,  B60R2300/103 ,  G06T2207/10048 ,  G06T2207/30208

Abstract: A computer-implemented method of field calibrating a device is disclosed. In one example, a reference image is acquired, via an infrared camera, while the device is in a factory-calibrated state. The reference image measures a factory-calibrated spatial relationship of one or more infrared-visible fiducial markers of the device relative to the infrared camera while the device is in the factory-calibrated state. Later, a field image is acquired, via the infrared camera. The field image measures an updated spatial relationship of the one or more infrared-visible fiducial markers relative to the infrared camera. The device is field calibrated based on the reference image and the field image.

公开(公告)号：US12277725B2

公开(公告)日：2025-04-15

申请号：US17506632

申请日：2021-10-20

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Paulo Ricardo Dos Santos Mendonca ,  Rayna Demaster-Smith ,  Christopher Charles Aholt ,  Christopher Maurice Mei

IPC: G06T7/73 ,  G02B27/00 ,  G02B27/01 ,  G06T7/80 ,  G06V40/19

Abstract: The disclosed techniques provide enhanced eye tracking systems utilizing joint estimation of biological parameters and hardware parameters. A system uses joint estimation of biological parameters, e.g., direction and position of an eye, with concurrent estimation of hardware parameters, e.g., camera position or camera direction, to self-calibrate and provide eye tracking estimations to accommodate for deformations and other changes of a device. Sensor data is used to select hardware parameters of a camera for use in the joint estimation with the biological parameters, where the hardware parameters are estimated based on glint and pupil position of a user. The disclosed techniques include a method to model changes of a device, as well as detect and compensate for them while the eye-tracking device is in normal use, without requiring a factory-calibration procedure to be repeated.

公开(公告)号：US11716456B2

公开(公告)日：2023-08-01

申请号：US17326965

申请日：2021-05-21

Applicant: Microsoft Technology Licensing, LLC

Inventor： Michael Edward Samples ,  Dmitry Reshidko ,  Rayna Demaster-Smith

IPC: G09G5/00 ,  H04N13/327 ,  H04N13/344 ,  H04N13/363 ,  H04N9/31

CPC classification number: H04N13/327 ,  H04N9/3164 ,  H04N9/3194 ,  H04N13/344 ,  H04N13/363

Abstract: A near-eye display device comprises right and left display projectors, expansion optics, and inertial measurement units (IMUs), in addition to a plurality of angle-sensitive pixel (ASP) elements and a computer. The right and left expansion optics are configured to receive respective display images from the right and left display projectors and to release expanded forms of the display images. The right IMU is fixedly coupled to the right display projector, and the left IMU is fixedly coupled to the left display projector. Each ASP element is responsive to an angle of light of one of the respective display images as received into the right or left expansion optic. The computer is configured to receive output from the right IMU, the left IMU and the plurality of ASP elements, and render display data for the right and left display projectors based in part on the output.

公开(公告)号：US11512952B1

公开(公告)日：2022-11-29

申请号：US17364783

申请日：2021-06-30

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Navid Poulad ,  Rayna Demaster-Smith ,  Georg Klein ,  Jeffrey Neil Margolis

IPC: G01B21/24 ,  G01D21/02 ,  G02B27/01

Abstract: The techniques disclosed herein detect sensor misalignments in a display device by the use of sensors operating under different modalities. In some configurations, a near-to-eye display device can include a number of sensors that can be used to track movement of the device relative to a surrounding environment. The device can utilize multiple sensors operating under multiple modalities. For each sensor, there is a set of intrinsic and extrinsic properties that are calibrated. The device is also configured to determine refined estimations of the intrinsic and extrinsic properties at runtime. The refined estimations of the intrinsic and extrinsic properties can then be used to derive knowledge on how the device has deformed over time. The device can then use the refined estimations of the intrinsic and extrinsic properties and/or any other resulting data that quantifies any deformations of the device to make adjustments to rendered images at runtime.