-
公开(公告)号:US09747726B2
公开(公告)日:2017-08-29
申请号:US15227453
申请日:2016-08-03
Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
Inventor: Oliver Michael Christian Williams , Paul Barham , Michael Isard , Tuan Wong , Kevin Woo , Georg Klein , Douglas Kevin Service , Ashraf Ayman Michail , Andrew Pearson , Martin Shetter , Jeffrey Neil Margolis , Nathan Ackerman , Calvin Chan , Arthur C. Tomlin
IPC: G06T19/00 , G02B27/01 , G06F3/01 , G06F3/0481 , G06K9/62 , G06K9/66 , G06T3/20 , G09G3/3208
CPC classification number: G06T19/006 , G02B27/017 , G02B27/0172 , G02B27/0179 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G06F3/012 , G06F3/013 , G06F3/04815 , G06K9/6215 , G06K9/66 , G06T3/20 , G09G3/3208 , G09G2300/04
Abstract: Methods for generating and displaying images associated with one or more virtual objects within an augmented reality environment at a frame rate that is greater than a rendering frame rate are described. The rendering frame rate may correspond with the minimum time to render images associated with a pose of a head-mounted display device (HMD). In some embodiments, the HMD may determine a predicted pose associated with a future position and orientation of the HMD, generate a pre-rendered image based on the predicted pose, determine an updated pose associated with the HMD subsequent to generating the pre-rendered image, generate an updated image based on the updated pose and the pre-rendered image, and display the updated image on the HMD. The updated image may be generated via a homographic transformation and/or a pixel offset adjustment of the pre-rendered image.
-
公开(公告)号:US09514571B2
公开(公告)日:2016-12-06
申请号:US13951351
申请日:2013-07-25
Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
Inventor: Oliver Michael Christian Williams , Paul Barham , Michael Isard , Tuan Wong , Kevin Woo , Georg Klein , Douglas Kevin Service , Ashraf Ayman Michail , Andrew Pearson , Martin Shetter , Jeffrey Neil Margolis , Nathan Ackerman , Calvin Chan , Arthur C. Tomlin
IPC: G06T19/00 , G02B27/01 , G06F3/01 , G06F3/0481
CPC classification number: G06T19/006 , G02B27/017 , G02B27/0172 , G02B27/0179 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G06F3/012 , G06F3/013 , G06F3/04815 , G06K9/6215 , G06K9/66 , G06T3/20 , G09G3/3208 , G09G2300/04
Abstract: Methods for generating and displaying images associated with one or more virtual objects within an augmented reality environment at a frame rate that is greater than a rendering frame rate are described. The rendering frame rate may correspond with the minimum time to render images associated with a pose of a head-mounted display device (HMD). In some embodiments, the HMD may determine a predicted pose associated with a future position and orientation of the HMD, generate a pre-rendered image based on the predicted pose, determine an updated pose associated with the HMD subsequent to generating the pre-rendered image, generate an updated image based on the updated pose and the pre-rendered image, and display the updated image on the HMD. The updated image may be generated via a homographic transformation and/or a pixel offset adjustment of the pre-rendered image.
Abstract translation: 描述了以大于渲染帧速率的帧速率在增强现实环境内生成和显示与一个或多个虚拟对象相关联的图像的方法。 渲染帧速率可以对应于渲染与头戴式显示设备(HMD)的姿势相关联的图像的最小时间。 在一些实施例中,HMD可以确定与HMD的未来位置和取向相关联的预测姿态,基于预测姿态生成预渲染图像,在生成预渲染图像之后确定与HMD相关联的更新姿态 基于更新的姿势和预先呈现的图像生成更新的图像,并且在HMD上显示更新的图像。 可以经由预渲染图像的同形变换和/或像素偏移调整来生成更新的图像。
-
公开(公告)号:US10129523B2
公开(公告)日:2018-11-13
申请号:US15190085
申请日:2016-06-22
Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
Inventor: Ashraf Ayman Michail , Georg Klein , Andrew Martin Pearson , Zsolt Mathe , Mark S. Grossman , Ning Xu
IPC: G06T15/00 , H04N13/128 , H04N13/111 , H04N13/324 , H04N13/332 , H04N13/366 , G06T3/60 , G06T19/00 , G06T19/20 , G06F3/01 , G06T15/06
Abstract: Examples are disclosed that relate to depth-aware late-stage reprojection. One example provides a computing system configured to receive and store image data, receive a depth map for the image data, processing the depth map to obtain a blurred depth map, and based upon motion data, determine a translation to be made to the image data. Further, for each pixel, the computing system is configured to translate an original ray extending from an original virtual camera location to an original frame buffer location to a reprojected ray extending from a translated camera location to a reprojected frame buffer location, determine a location at which the reprojected ray intersects the blurred depth map, and sample a color of a pixel for display based upon a color corresponding to the location at which the reprojected ray intersects the blurred depth map.
-
公开(公告)号:US09626802B2
公开(公告)日:2017-04-18
申请号:US14267755
申请日:2014-05-01
Applicant: Microsoft Technology Licensing, LLC
Inventor: Adam G. Poulos , Arthur Tomlin , Tony Ambrus , Jeffrey Cole , Ian Douglas McIntyre , Drew Steedly , Frederik Schaffalitzky , Georg Klein , Kathleen P. Mulcahy
IPC: G02B27/01 , G06K9/46 , G06T19/00 , G06K9/62 , G06F3/01 , G06F3/0481 , G06K9/00 , G06T7/20 , G06K9/20
CPC classification number: G06T7/248 , G02B27/017 , G02B2027/0138 , G02B2027/014 , G02B2027/0141 , G02B2027/0178 , G06F3/011 , G06F3/012 , G06F3/017 , G06F3/04815 , G06K9/00208 , G06K9/00624 , G06K9/00671 , G06K9/00791 , G06K9/00832 , G06K9/2018 , G06K9/4604 , G06K9/6215 , G06T7/20 , G06T7/60 , G06T19/006 , G06T2207/30252
Abstract: Embodiments are disclosed for methods and systems of distinguishing movements of features in a physical environment. For example, on a head-mounted display device, one embodiment of a method includes obtaining a representation of real-world features in two or more coordinate frames and obtaining motion data from one or more sensors external to the head-mounted display device. The method further includes distinguishing features in one coordinate frame from features in another coordinate frame based upon the motion data.
-
公开(公告)号:US11512952B1
公开(公告)日:2022-11-29
申请号:US17364783
申请日:2021-06-30
Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
Inventor: Navid Poulad , Rayna Demaster-Smith , Georg Klein , Jeffrey Neil Margolis
Abstract: The techniques disclosed herein detect sensor misalignments in a display device by the use of sensors operating under different modalities. In some configurations, a near-to-eye display device can include a number of sensors that can be used to track movement of the device relative to a surrounding environment. The device can utilize multiple sensors operating under multiple modalities. For each sensor, there is a set of intrinsic and extrinsic properties that are calibrated. The device is also configured to determine refined estimations of the intrinsic and extrinsic properties at runtime. The refined estimations of the intrinsic and extrinsic properties can then be used to derive knowledge on how the device has deformed over time. The device can then use the refined estimations of the intrinsic and extrinsic properties and/or any other resulting data that quantifies any deformations of the device to make adjustments to rendered images at runtime.
-
公开(公告)号:US09495801B2
公开(公告)日:2016-11-15
申请号:US14267711
申请日:2014-05-01
Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
Inventor: Michael John Ebstyne , Frederik Schaffalitzky , Drew Steedly , Calvin Chan , Ethan Eade , Alex Kipman , Georg Klein
CPC classification number: G06T19/006 , G02B27/017 , G02B2027/0178 , G06F3/011 , G06F3/012 , G06F3/038
Abstract: An augmented reality device including a plurality of sensors configured to output pose information indicating a pose of the augmented reality device. The augmented reality device further includes a band-agnostic filter and a band-specific filter. The band-specific filter includes an error correction algorithm configured to receive pose information as filtered by the band-agnostic filter and reduce a tracking error of the pose information in a selected frequency band. The augmented reality device further includes a display engine configured to position a virtual object on a see-through display as a function of the pose information as filtered by the band-agnostic filter and the band-specific filter.
Abstract translation: 包括多个传感器的增强现实设备,被配置为输出指示增强现实设备的姿势的姿态信息。 增强现实设备还包括带无关滤波器和带特定滤波器。 频带特定滤波器包括错误校正算法,其被配置为接收被频带不可知滤波器滤波的姿势信息,并减少所选频带中的姿态信息的跟踪误差。 增强现实设备还包括被配置为根据由带无关滤波器和频带特定滤波器过滤的姿势信息来将虚拟对象定位在透视显示器上的显示引擎。
-
公开(公告)号:US09488837B2
公开(公告)日:2016-11-08
申请号:US13931464
申请日:2013-06-28
Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
Inventor: David Nister , Georg Klein
CPC classification number: G02B27/0172 , G02B3/0037 , G02B27/0093 , G02B27/01 , G02B27/017 , G02B2027/014 , G02B2027/0178
Abstract: A system and related methods for near-eye display of an image are provided. In one example, a near-eye display system includes a light source comprising a surface and a plurality of pixels having a pixel pitch of 5 microns or less. An aperture array is located between 2 mm and 5 mm from the surface of the light source. The aperture array comprises non-overlapping apertures that are each centered on a vertex of an equilateral triangle within a grid of equilateral triangles. The center of each aperture is spaced from the center of each adjacent aperture by an aperture spacing of between 1 mm and 9 mm. The aperture array selectively passes the light emitted from the pixels to display the image without a double image condition.
Abstract translation: 提供了用于近距离显示图像的系统和相关方法。 在一个示例中,近眼显示系统包括包括表面的光源和具有5微米或更小的像素间距的多个像素。 孔径阵列位于距离光源表面2mm至5mm之间。 孔径阵列包括不重叠的孔,其各自以等边三角形网格内的等边三角形的顶点为中心。 每个孔的中心与每个相邻孔的中心间隔开1mm至9mm之间的孔距。 孔径阵列选择性地传递从像素发射的光以在没有双重图像条件的情况下显示图像。
-
公开(公告)号:US20170206668A1
公开(公告)日:2017-07-20
申请号:US15474687
申请日:2017-03-30
Applicant: Microsoft Technology Licensing, LLC
Inventor: Adam G. Poulos , Arthur Tomlin , Tony Ambrus , Jeffrey Cole , Ian Douglas McIntyre , Drew Steedly , Frederik Schaffalitzky , Georg Klein , Kathleen P. Mulcahy
CPC classification number: G06T7/248 , G02B27/017 , G02B2027/0138 , G02B2027/014 , G02B2027/0141 , G02B2027/0178 , G06F3/011 , G06F3/012 , G06F3/017 , G06F3/04815 , G06K9/00208 , G06K9/00624 , G06K9/00671 , G06K9/00791 , G06K9/00832 , G06K9/2018 , G06K9/4604 , G06K9/6215 , G06T7/20 , G06T7/60 , G06T19/006 , G06T2207/30252
Abstract: Embodiments are disclosed for methods and systems of distinguishing movements of features in a physical environment. For example, on a head-mounted display device, one embodiment of a method includes obtaining a representation of real-world features in two or more coordinate frames and obtaining motion data from one or more sensors external to the head-mounted display device. The method further includes distinguishing features in one coordinate frame from features in another coordinate frame based upon the motion data.
-
公开(公告)号:US20160343172A1
公开(公告)日:2016-11-24
申请号:US15227453
申请日:2016-08-03
Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
Inventor: Oliver Michael Christian Williams , Paul Barham , Michael Isard , Tuan Wong , Kevin Woo , Georg Klein , Douglas Kevin Service , Ashraf Ayman Michail , Andrew Pearson , Martin Shetter , Jeffrey Neil Margolis , Nathan Ackerman , Calvin Chan , Arthur C. Tomlin
CPC classification number: G06T19/006 , G02B27/017 , G02B27/0172 , G02B27/0179 , G02B2027/014 , G02B2027/0178 , G02B2027/0187 , G06F3/012 , G06F3/013 , G06F3/04815 , G06K9/6215 , G06K9/66 , G06T3/20 , G09G3/3208 , G09G2300/04
Abstract: Methods for generating and displaying images associated with one or more virtual objects within an augmented reality environment at a frame rate that is greater than a rendering frame rate are described. The rendering frame rate may correspond with the minimum time to render images associated with a pose of a head-mounted display device (HMD). In some embodiments, the HMD may determine a predicted pose associated with a future position and orientation of the HMD, generate a pre-rendered image based on the predicted pose, determine an updated pose associated with the HMD subsequent to generating the pre-rendered image, generate an updated image based on the updated pose and the pre-rendered image, and display the updated image on the HMD. The updated image may be generated via a homographic transformation and/or a pixel offset adjustment of the pre-rendered image.
-
公开(公告)号:US10223799B2
公开(公告)日:2019-03-05
申请号:US15474687
申请日:2017-03-30
Applicant: Microsoft Technology Licensing, LLC
Inventor: Adam G. Poulos , Arthur Tomlin , Tony Ambrus , Jeffrey Cole , Ian Douglas McIntyre , Drew Steedly , Frederik Schaffalitzky , Georg Klein , Kathleen P. Mulcahy
IPC: G02B27/01 , G06T19/00 , G06T7/246 , G06T7/60 , G06K9/62 , G06K9/46 , G06F3/01 , G06F3/0481 , G06K9/00 , G06T7/20 , G06K9/20
Abstract: Embodiments are disclosed for methods and systems of distinguishing movements of features in a physical environment. For example, on a head-mounted display device, one embodiment of a method includes obtaining a representation of real-world features in two or more coordinate frames and obtaining motion data from one or more sensors external to the head-mounted display device. The method further includes distinguishing features in one coordinate frame from features in another coordinate frame based upon the motion data.
-
-
-
-
-
-
-
-
-