公开(公告)号：WO2018208463A1

公开(公告)日：2018-11-15

申请号：PCT/US2018/028719

申请日：2018-04-21

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： STEEDLY, Drew ,  SAMPLES, Michael Edward ,  BALAN, Alexandru Octavian ,  GUYMAN, William Douglas ,  JOVANOVIC, Vuk ,  KHAPKO, Taras ,  RAZUMENIC, Ivan ,  CARAPIC, Vladimir ,  SHETTER, Martin Thomas ,  MOJASEVIC, Jelena ,  GORIS, Andrew C. ,  BEZULJ, Marko

IPC: G06F3/01 ,  G06F3/03 ,  G06F3/033 ,  G06F3/038 ,  G06F3/0481 ,  G06F3/0346 ,  A63F13/213 ,  A63F9/24

Abstract: One disclosed example provides a head-mounted device configured to control a plurality of light sources of a handheld object and acquire image data comprising a sequence of environmental tracking exposures in which the plurality of light sources are controlled to have a lower integrated intensity and handheld object tracking exposures in which the plurality of light sources are controlled to have a higher integrated intensity. The instructions are further executable to detect, via an environmental tracking exposure, one or more features of the surrounding environment, determine a pose of the head-mounted device based upon the one or more features of the surrounding environment detected, detect via a handheld object tracking exposure the plurality of light sources of the handheld object, determine a pose of the handheld object relative to the head-mounted device based upon the plurality of light sources detected, and output the pose of the handheld object.

公开(公告)号：WO2022245507A1

公开(公告)日：2022-11-24

申请号：PCT/US2022/026617

申请日：2022-04-28

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： SAMPLES, Michael Edward ,  RESHIDKO, Dmitry ,  DEMASTER-SMITH, Rayna

IPC: H04N13/344 ,  H04N13/327

Abstract: A near-eye display device comprises right and left display projectors, expansion optics, and inertial measurement units (IMUs), in addition to a plurality of angle-sensitive pixel (ASP) elements and a computer. The right and left expansion optics are configured to receive respective display images from the right and left display projectors and to release expanded forms of the display images. The right IMU is fixedly coupled to the right display projector, and the left IMU is fixedly coupled to the left display projector. Each ASP element is responsive to an angle of light of one of the respective display images as received into the right or left expansion optic. The computer is configured to receive output from the right IMU, the left IMU and the plurality of ASP elements, and render display data for the right and left display projectors based in part on the output.

公开(公告)号：WO2018208465A1

公开(公告)日：2018-11-15

申请号：PCT/US2018/028721

申请日：2018-04-21

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： SAMPLES, Michael Edward ,  BALAN, Alexandru Octavian ,  SIRTKAYA, Salim ,  JOVANOVIC, Vuk ,  PANJEVIC, Filip ,  KHAPKO, Taras ,  RIVERA, Ruven Jaime, III

IPC: G06F3/01 ,  G06F3/03 ,  G06F3/033 ,  G06F3/038 ,  G06F3/0481 ,  G06F3/0346 ,  A63F13/213 ,  A63F9/24 ,  G06T7/80

Abstract: One disclosed example provides a head-mounted device including a stereo camera arrangement, a logic device configured to execute instructions, and a storage device storing instructions executable by the logic device to, for each camera in the stereo camera arrangement, receive image data of a field of view of the camera, detect light sources of a handheld object in the image data, and based upon the light sources detected, determine a pose of the handheld object. The instructions are executable to, based upon the pose of the handheld object determined for each camera in the stereo camera arrangement, calibrate the stereo camera arrangement.

公开(公告)号：WO2018048822A1

公开(公告)日：2018-03-15

申请号：PCT/US2017/050150

申请日：2017-09-06

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： ROBBINS, Steven John ,  STEEDLY, Drew Edward ,  SAMPLES, Michael Edward ,  LIU, Zhiqiang ,  JUENGER, Andrew K.

IPC: G09G5/00 ,  G02B27/01

CPC classification number: G06F3/012 ,  G02B27/0172 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0178 ,  G06T11/001 ,  G06T11/60 ,  G09G3/003 ,  G09G5/00 ,  G09G2320/0693 ,  G09G2320/08 ,  G09G2340/0457 ,  G09G2340/0464 ,  G09G2354/00

Abstract: A display system includes a display alignment tracker configured track the position of a first signal in a first waveguide and the position of a second signal in a second waveguide. The display alignment tracker optically multiplexes a portion of a first signal and a portion of the second signal into a combined optical signal and measures a differential between the first signal and the second signal. The differential is used to adjust the position, dimensions, or a color attribute of the first signal relative to the second signal.

Abstract translation: 显示系统包括显示器对准跟踪器，其被配置为跟踪第一波导中的第一信号的位置和第二波导中的第二信号的位置。 显示对准跟踪器将第一信号的一部分和第二信号的一部分光学复用为组合光信号并测量第一信号和第二信号之间的差分。 差分用于调整第一个信号相对于第二个信号的位置，尺寸或颜色属性。

公开(公告)号：WO2022256127A1

公开(公告)日：2022-12-08

申请号：PCT/US2022/027965

申请日：2022-05-06

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： WU, Yinan ,  POULAD, Navid ,  LIU, Dapeng ,  BOSWELL, Trevor Grant ,  DEMASTER-SMITH, Rayna ,  RICCOMINI, Roy Joseph ,  SAMPLES, Michael Edward ,  CHEONG, Yuenkeen

IPC: G02B27/00 ,  G02B27/01

Abstract: Examples are disclosed that relate to calibration data related to a determined alignment of sensors on a wearable display device. One example provides a wearable display device comprising a frame, a first sensor and a second sensor, one or more displays, a logic system, and a storage system. The storage system comprises calibration data related to a determined alignment of the sensors with the frame in a bent configuration and instructions executable by the logic system. The instructions are executable to obtain a first sensor data and a second sensor data respectfully from the first and second sensors, determine a distance from the wearable display device to a feature based at least upon the first and second sensor data using the calibration data, obtain a stereo image to display based upon the distance from the wearable display device to the feature, and output the stereo image via the displays.

公开(公告)号：WO2021257155A1

公开(公告)日：2021-12-23

申请号：PCT/US2021/026081

申请日：2021-04-07

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： SAMPLES, Michael Edward ,  SMIRNOV, Mikhail ,  HOUBEN, Jozef Barnabas ,  DOMJAN, Damon Marlow ,  MILLER, Joshua Owen

IPC: H04N9/31 ,  G02B26/08 ,  G01K13/08 ,  G02B26/0833 ,  G02B26/0858 ,  G02B26/101 ,  G02B26/105 ,  G06K9/629 ,  H04N9/3135 ,  H04N9/3194

Abstract: A MEMS scanning device ("Device") includes at least (1) laser projector(s) controlled by a laser drive to project a laser beam, (2) MEMS scanning mirror(s) controlled by a MEMS drive to scan the laser beam to generate a raster scan, (3) a display configured to receive the raster scan, (4) a thermometer configured to detect a current temperature, (5) a display observing camera configured to capture an image of a predetermined area of the display, and (6) a computer-readable media that stores temperature model(s), each of which is custom-built using machine learning. The device uses the display observing camera to capture image(s) of predetermined pattern(s), which are then used to extract feature(s). The extracted feature(s) are compared with ideal feature(s) to identify a discrepancy. When the identified discrepancy is greater than a threshold, the temperature model(s) are updated accordingly.

公开(公告)号：WO2018048821A1

公开(公告)日：2018-03-15

申请号：PCT/US2017/050149

申请日：2017-09-06

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： ROBBINS, Steven John ,  STEEDLY, Drew Edward ,  SAMPLES, Michael Edward ,  LIU, Zhiqiang ,  JUENGER, Andrew K.

IPC: G02B27/01

CPC classification number: G02B27/0172 ,  G02B5/18 ,  G02B6/00 ,  G02B6/0016 ,  G02B6/0075 ,  G02B6/0078 ,  G02B27/017 ,  G02B2027/0112 ,  G02B2027/014 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06T3/00 ,  G06T7/74 ,  G06T2207/20221 ,  G09G3/003 ,  G09G2320/0666 ,  G09G2320/0693 ,  G09G2330/12 ,  G09G2340/0464 ,  G09G2356/00 ,  G09G2360/145

Abstract: A display system includes a display alignment tracker configured to track the position of a first signal and the position of a second signal. The display alignment tracker optically multiplexes a portion of a first signal and of the second signal into a combined optical signal and measures a differential between the first signal and the second signal. A system for rendering optical signals on a head-mounted display, comprising: a first waveguide configured to guide a first signal therethrough; a second waveguide configured to guide a second signal therethrough; an optical multiplexer in optical communication with the first and second waveguides and configured to combine at least a portion of the first signal and of the second signal; and an optical sensor in optical communication with the optical multiplexer and configured to receive a combined optical signal including at least a portion of the first and of the second signal.

Abstract translation: 显示系统包括显示器对准跟踪器，其被配置为跟踪第一信号的位置和第二信号的位置。 显示器对准跟踪器将第一信号和第二信号的一部分光学复用为组合光信号并测量第一信号和第二信号之间的差分。 一种用于在头戴式显示器上呈现光信号的系统，包括：第一波导，其被配置为引导第一信号通过其; 第二波导，其被配置为引导第二信号通过其中; 与第一和第二波导光学通信并且被配置为组合第一信号和第二信号的至少一部分的光学多路复用器; 以及光学传感器，与光学多路复用器进行光学通信并被配置为接收包括第一信号和第二信号的至少一部分的组合光学信号。

公开(公告)号：WO2022019977A1

公开(公告)日：2022-01-27

申请号：PCT/US2021/029515

申请日：2021-04-28

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： BLEYER, Michael ,  EDMONDS, Christopher Douglas ,  SAMPLES, Michael Edward ,  SINHA, Sudipta Narayan ,  KARR, Matthew Beaudoin ,  PRICE, Raymond Kirk

IPC: G06T7/292 ,  G06T7/246 ,  G06T7/33

Abstract: A system for continuous image alignment of separate cameras identifies a reference camera transformation matrix between a base reference camera pose and an updated reference camera pose. The system also identifies a match camera transformation matrix between a base match camera pose and an updated match camera pose and an alignment matrix based on visual correspondences between one or more reference frames captured by the reference camera and one or more match frames captured by the match camera. The system also generates a motion model configured to facilitate mapping of a set of pixels of a reference frame captured by the reference camera to a corresponding set of pixels of a match frame captured by the match camera based on the reference camera transformation matrix, the match camera transformation matrix, and the alignment matrix.

公开(公告)号：WO2018208470A1

公开(公告)日：2018-11-15

申请号：PCT/US2018/028726

申请日：2018-04-21

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： STEEDLY, Drew ,  SAMPLES, Michael Edward ,  BALAN, Alexandru Octavian ,  SIRTKAYA, Salim ,  GUYMAN, William Douglas ,  JOVANOVIC, Vuk ,  PANJEVIC, Filip

IPC: G06F3/01 ,  G06F3/03 ,  G06F3/033 ,  G06F3/038 ,  G06F3/0481 ,  G06F3/0346 ,  A63F13/213 ,  A63F9/24 ,  G02B27/01

Abstract: One disclosed example provides a computing device configured to receive from an image sensor of a head-mounted device environmental tracking exposures and handheld object tracking exposures, determine a pose of the handheld object with respect to the head-mounted device based upon the handheld object tracking exposures, determine a pose of the head-mounted device with respect to a surrounding environment based upon the environmental tracking exposures, derive a pose of the handheld object relative to the surrounding environment based upon the pose of the handheld object with respect to the head-mounted device and the pose of the head-mounted device with respect to the surrounding environment, and output the pose of the handheld object relative to the surrounding environment for controlling a user interface displayed on the head-mounted device.

公开(公告)号：WO2018005069A1

公开(公告)日：2018-01-04

申请号：PCT/US2017/037104

申请日：2017-06-13

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： MCCULLOCH, Daniel Joseph ,  FAJT, Nicholas Gervase ,  POULOS, Adam G. ,  EDMONDS, Christopher Douglas ,  CHERKASHIN, Lev ,  ALLEN, Brent Charles ,  DULU, Constantin ,  KAPASI, Muhammad Jabir ,  GRABNER, Michael ,  SAMPLES, Michael Edward ,  BONG, Cecilia ,  SUSFFALICH, Miguel Angel ,  MANI, Varun Ramesh ,  AMBRUS, Anthony James ,  TOMLIN, Arthur C. ,  DACK, James Gerard ,  KOHLER, Jeffrey Alan ,  REHMEYER, Eric S. ,  PARKER, Edward D.

IPC: G06F3/01 ,  G06K9/00 ,  G06T7/20 ,  G02B27/01 ,  G06F3/0481 ,  G06K9/20

CPC classification number: G06T19/006 ,  G02B27/017 ,  G02B2027/014 ,  G02B2027/0187 ,  G03H1/0005 ,  G03H2001/0088 ,  G06F3/011 ,  G06F3/04815 ,  G06K9/00208 ,  G06K9/00624 ,  G06K9/00664 ,  G06K9/00671 ,  G06K9/00791 ,  G06K9/2018 ,  G06T7/20 ,  G06T2207/30196 ,  G06T2207/30241

Abstract: In embodiments of augmenting a moveable entity with a hologram, an alternate reality device (100) includes a tracking system (108) that can recognize an entity in an environment and track movement of the entity in the environment. The alternate reality device can also include a detection algorithm (128) implemented to identify the entity recognized by the tracking system based on identifiable characteristics of the entity. A hologram positioning application (124) is implemented to receive motion data from the tracking system, receive entity characteristic data from the detection algorithm, and determine a position and an orientation of the entity in the environment based on the motion data and the entity characteristic data. The hologram positioning application can then generate a hologram that appears associated with the entity as the entity moves in the environment.

Abstract translation: 在用全息图增强可移动实体的实施例中，替代现实设备（100）包括可识别环境中的实体并跟踪环境中的实体的移动的跟踪系统（108） 。 替代现实设备还可以包括检测算法（128），所述检测算法被实现为基于所述实体的可识别特征来识别由所述跟踪系统识别的实体。 全息图定位应用（124）被实现为从跟踪系统接收运动数据，从检测算法接收实体特征数据，并基于运动数据和实体特征数据确定实体在环境中的位置和方位 。 然后全息图定位应用程序可以生成全息图，随着实体在环境中移动，该全息图出现与实体相关联。