-
公开(公告)号:US11778160B2
公开(公告)日:2023-10-03
申请号:US17336119
申请日:2021-06-01
Applicant: Microsoft Technology Licensing, LLC
Inventor: Yinan Wu , Navid Poulad , Dapeng Liu , Trevor Grant Boswell , Rayna DeMaster-Smith , Roy Joseph Riccomini , Michael Edward Samples , Yuenkeen Cheong
IPC: H04N13/246 , G06F3/01 , H04N13/239 , H04N13/366
CPC classification number: H04N13/246 , G06F3/013 , H04N13/239 , H04N13/366 , H04N2213/008
Abstract: Examples are disclosed that relate to calibration data related to a determined alignment of sensors on a wearable display device. One example provides a wearable display device comprising a frame, a first sensor and a second sensor, one or more displays, a logic system, and a storage system. The storage system comprises calibration data related to a determined alignment of the sensors with the frame in a bent configuration and instructions executable by the logic system. The instructions are executable to obtain a first sensor data and a second sensor data respectfully from the first and second sensors, determine a distance from the wearable display device to a feature based at least upon the first and second sensor data using the calibration data, obtain a stereo image to display based upon the distance from the wearable display device to the feature, and output the stereo image via the displays.
-
公开(公告)号:US11314321B2
公开(公告)日:2022-04-26
申请号:US16922311
申请日:2020-07-07
Applicant: Microsoft Technology Licensing, LLC
Inventor: Drew Steedly , Michael Edward Samples , Alexandru Octavian Balan , William Douglas Guyman , Vuk Jovanovic , Taras Khapko , Ivan Razumenic , Vladimir Carapic , Martin Thomas Shetter , Jelena Mojasevic , Andrew C. Goris , Marko Bezulj
IPC: A63F13/211 , A63F13/212 , A63F13/213 , A63F13/22 , A63F13/235 , A63F13/24 , A63F13/25 , A63F13/31 , A63F13/42 , A63F13/428 , A63F13/5255 , A63F13/53 , A63F13/80 , A63F13/92 , F21V23/04 , G01B11/00 , G01C19/5776 , G01D5/26 , G01J1/44 , G02B27/01 , G06F3/01 , G06F3/03 , G06F3/033 , G06F3/0346 , G06F3/038 , G06F3/0481 , G06T7/246 , G06T7/285 , G06T7/70 , G06T7/73 , G06T7/80 , H04N13/204 , H04N13/239 , G06F3/04815 , H04N13/246 , H04N13/254 , H05B45/10 , H05B47/11 , H05B47/19 , H05B47/125
Abstract: One disclosed example provides a head-mounted device configured to control a plurality of light sources of a handheld object and acquire image data comprising a sequence of environmental tracking exposures in which the plurality of light sources are controlled to have a lower integrated intensity and handheld object tracking exposures in which the plurality of light sources are controlled to have a higher integrated intensity. The instructions are further executable to detect, via an environmental tracking exposure, one or more features of the surrounding environment, determine a pose of the head-mounted device based upon the one or more features of the surrounding environment detected, detect via a handheld object tracking exposure the plurality of light sources of the handheld object, determine a pose of the handheld object relative to the head-mounted device based upon the plurality of light sources detected, and output the pose of the handheld object.
-
公开(公告)号:US11743434B2
公开(公告)日:2023-08-29
申请号:US17832180
申请日:2022-06-03
Applicant: Microsoft Technology Licensing, LLC
Inventor: Michael Edward Samples , Mikhail Smirnov , Jozef Barnabas Houben , Damon Marlow Domjan , Joshua Owen Miller
CPC classification number: H04N9/3135 , G01K13/08 , G02B26/0858 , G02B26/101 , G06F18/253 , H04N9/3194
Abstract: A MEMS scanning device (“Device”) includes at least (1) laser projector(s) controlled by a laser drive to project a laser beam, (2) MEMS scanning mirror(s) controlled by a MEMS drive to scan the laser beam to generate a raster scan, (3) a display configured to receive the raster scan, (4) a thermometer configured to detect a current temperature, (5) a display observing camera configured to capture an image of a predetermined area of the display, and (6) a computer-readable media that stores temperature model(s), each of which is custom-built using machine learning. The device uses the display observing camera to capture image(s) of predetermined pattern(s), which are then used to extract feature(s). The extracted feature(s) are compared with ideal feature(s) to identify a discrepancy. When the identified discrepancy is greater than a threshold, the temperature model(s) are updated accordingly.
-
公开(公告)号:US10203781B2
公开(公告)日:2019-02-12
申请号:US15192329
申请日:2016-06-24
Applicant: Microsoft Technology Licensing, LLC
Inventor: Anatolie Gavriliuc , Shawn Crispin Wright , Jeffrey Alan Kohler , Quentin Simon Charles Miller , Scott Francis Fullam , Sergio Paolantonio , Michael Edward Samples , Anthony James Ambrus
IPC: G06F3/041 , G06F3/038 , G06F3/01 , G06F3/0346 , G06F3/0354 , G06T19/00 , G06F3/03
Abstract: In various embodiments, methods and systems for implementing integrated free space and surface inputs are provided. An integrated free space and surface input system includes a mixed-input pointing device for interacting and controlling interface objects using free space inputs and surface inputs, trigger buttons, pressure sensors, and haptic feedback associated with the mixed-input pointing device. Free space movement data and surface movement data are tracked and determined for the mixed-input pointing device. An interface input is detected for the mixed-input pointing device transitioning from a first input to a second input, such as, from a free space input to a surface input or from the surface input to the free space input. The interface input is processed based on accessing the free space movement data and the surface movement data. An output for the interface input is communicated from the mixed-input pointing device to interact and control an interface.
-
公开(公告)号:US11716456B2
公开(公告)日:2023-08-01
申请号:US17326965
申请日:2021-05-21
Applicant: Microsoft Technology Licensing, LLC
Inventor: Michael Edward Samples , Dmitry Reshidko , Rayna Demaster-Smith
IPC: G09G5/00 , H04N13/327 , H04N13/344 , H04N13/363 , H04N9/31
CPC classification number: H04N13/327 , H04N9/3164 , H04N9/3194 , H04N13/344 , H04N13/363
Abstract: A near-eye display device comprises right and left display projectors, expansion optics, and inertial measurement units (IMUs), in addition to a plurality of angle-sensitive pixel (ASP) elements and a computer. The right and left expansion optics are configured to receive respective display images from the right and left display projectors and to release expanded forms of the display images. The right IMU is fixedly coupled to the right display projector, and the left IMU is fixedly coupled to the left display projector. Each ASP element is responsive to an angle of light of one of the respective display images as received into the right or left expansion optic. The computer is configured to receive output from the right IMU, the left IMU and the plurality of ASP elements, and render display data for the right and left display projectors based in part on the output.
-
公开(公告)号:US11450014B2
公开(公告)日:2022-09-20
申请号:US16936377
申请日:2020-07-22
Applicant: Microsoft Technology Licensing, LLC
Inventor: Michael Bleyer , Christopher Douglas Edmonds , Michael Edward Samples , Sudipta Narayan Sinha , Matthew Beaudoin Karr , Raymond Kirk Price
Abstract: A system for continuous image alignment of separate cameras identifies a reference camera transformation matrix between a base reference camera pose and an updated reference camera pose. The system also identifies a match camera transformation matrix between a base match camera pose and an updated match camera pose and an alignment matrix based on visual correspondences between one or more reference frames captured by the reference camera and one or more match frames captured by the match camera. The system also generates a motion model configured to facilitate mapping of a set of pixels of a reference frame captured by the reference camera to a corresponding set of pixels of a match frame captured by the match camera based on the reference camera transformation matrix, the match camera transformation matrix, and the alignment matrix.
-
公开(公告)号:US10324291B2
公开(公告)日:2019-06-18
申请号:US15263212
申请日:2016-09-12
Applicant: Microsoft Technology Licensing, LLC
Inventor: Steven John Robbins , Drew Edward Steedly , Michael Edward Samples , Zhiqiang Liu , Andrew K. Juenger
Abstract: A display system includes a display alignment tracker configured track the position of a first signal and the position of a second signal. The display alignment tracker optically multiplexes a portion of a first signal and a portion of the second signal into a combined optical signal and measures a differential between the first signal and the second signal.
-
公开(公告)号:US10216263B2
公开(公告)日:2019-02-26
申请号:US15263220
申请日:2016-09-12
Applicant: Microsoft Technology Licensing, LLC
Inventor: Steven John Robbins , Drew Edward Steedly , Michael Edward Samples , Zhiqiang Liu , Andrew K. Juenger
Abstract: A display system includes a display alignment tracker configured track the position of a first signal in a first waveguide and the position of a second signal in a second waveguide. The display alignment tracker optically multiplexes a portion of a first signal and a portion of the second signal into a combined optical signal and measures a differential between the first signal and the second signal. The differential is used to adjust the position, dimensions, or a color attribute of the first signal relative to the second signal.
-
公开(公告)号:US11368658B2
公开(公告)日:2022-06-21
申请号:US16901481
申请日:2020-06-15
Applicant: Microsoft Technology Licensing, LLC
Inventor: Michael Edward Samples , Mikhail Smirnov , Jozef Barnabas Houben , Damon Marlow Domjan , Joshua Owen Miller
Abstract: A MEMS scanning device (“Device”) includes at least (1) laser projector(s) controlled by a laser drive to project a laser beam, (2) MEMS scanning mirror(s) controlled by a MEMS drive to scan the laser beam to generate a raster scan, (3) a display configured to receive the raster scan, (4) a thermometer configured to detect a current temperature, (5) a display observing camera configured to capture an image of a predetermined area of the display, and (6) a computer-readable media that stores temperature model(s), each of which is custom-built using machine learning. The device uses the display observing camera to capture image(s) of predetermined pattern(s), which are then used to extract feature(s). The extracted feature(s) are compared with ideal feature(s) to identify a discrepancy. When the identified discrepancy is greater than a threshold, the temperature model(s) are updated accordingly.
-
公开(公告)号:US10719125B2
公开(公告)日:2020-07-21
申请号:US15826560
申请日:2017-11-29
Applicant: Microsoft Technology Licensing, LLC
Inventor: Drew Steedly , Michael Edward Samples , Alexandru Octavian Balan , William Douglas Guyman , Vuk Jovanovic , Taras Khapko , Ivan Razumenic , Vladimir Carapic , Martin Thomas Shetter , Jelena Mojasevic , Andrew C. Goris , Marko Bezulj
IPC: A63F13/211 , A63F13/212 , A63F13/213 , A63F13/22 , A63F13/235 , A63F13/24 , A63F13/25 , A63F13/31 , A63F13/42 , A63F13/428 , A63F13/5255 , A63F13/53 , A63F13/80 , A63F13/92 , F21V23/04 , G01B11/00 , G01C19/5776 , G01D5/26 , G01J1/44 , G02B27/01 , G06F3/01 , G06F3/03 , G06F3/033 , G06F3/0346 , G06F3/038 , G06F3/0481 , G06T7/246 , G06T7/285 , G06T7/70 , G06T7/73 , G06T7/80 , H04N13/204 , H04N13/239 , H04N13/246 , H04N13/254 , H05B45/10 , H05B47/105 , H05B47/11 , H05B47/125 , H05B47/19
Abstract: One disclosed example provides a head-mounted device configured to control a plurality of light sources of a handheld object and acquire image data comprising a sequence of environmental tracking exposures in which the plurality of light sources are controlled to have a lower integrated intensity and handheld object tracking exposures in which the plurality of light sources are controlled to have a higher integrated intensity. The instructions are further executable to detect, via an environmental tracking exposure, one or more features of the surrounding environment, determine a pose of the head-mounted device based upon the one or more features of the surrounding environment detected, detect via a handheld object tracking exposure the plurality of light sources of the handheld object, determine a pose of the handheld object relative to the head-mounted device based upon the plurality of light sources detected, and output the pose of the handheld object.
-
-
-
-
-
-
-
-
-