-
公开(公告)号:US11113894B1
公开(公告)日:2021-09-07
申请号:US17018753
申请日:2020-09-11
Applicant: Microsoft Technology Licensing, LLC
Inventor: Raymond Kirk Price , Michael Bleyer , Christopher Douglas Edmonds
Abstract: Systems are configured for performing GPS-based and sensor-based relocalization. During the relocalization, the systems are configured to obtain radio-based positioning data indicating an estimated position of the system within a mapped environment. The systems are also configured to identify, based on the estimated position, a subset of keyframes of a map of the mapped environment, wherein the map of the mapped environment includes a plurality of keyframes captured from a plurality of locations within the mapped environment, and the plurality of keyframes are associated with anchor points identified within the mapped environment. The systems are further configured to perform relocalization within the mapped environment based on the subset of keyframes.
-
公开(公告)号:US11075234B2
公开(公告)日:2021-07-27
申请号:US15943140
申请日:2018-04-02
Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
Inventor: Raymond Kirk Price , Kai Zang , Michael Bleyer
Abstract: Optimizations are provided for a high dynamic range (HDR) sensor. This sensor is a spatially multiplexed image sensor that includes at least two sets of red, green, and blue (RGB) pixels. Each red pixel in the second set of RGB pixels is positioned proximately and sometimes, adjacently, to at least one red pixel in the first set of RGB pixels. Each green pixel in the second set of RGB pixels is positioned proximately to at least one green pixel in the first set of RGB pixels. Each blue pixel in the second set of RGB pixels is positioned proximately to at least one blue pixel in the first set of RGB pixel. This spatially multiplexed image sensor is able to generate a digital image with reduced motion blurring artifacts.
-
公开(公告)号:US11074704B2
公开(公告)日:2021-07-27
申请号:US16240596
申请日:2019-01-04
Applicant: Microsoft Technology Licensing, LLC
Inventor: Michael Bleyer , Christopher D. Edmonds , Yuri Pekelny
Abstract: The described implementations relate to reducing distance errors in depth maps. One example can detect blooming in a depth map. This example can identify a depth range affected by the blooming and take an action relating to the identified depth range to address the blooming.
-
公开(公告)号:US20210136347A1
公开(公告)日:2021-05-06
申请号:US17146232
申请日:2021-01-11
Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
Inventor: Michael Bleyer , Yuri Pekelny , Raymond Kirk Price
IPC: H04N13/271 , G06T15/04 , H04N5/33 , G06T19/00 , G06F3/01 , G06T7/593 , H04N13/239 , H04N13/254 , G06F3/0346 , G09G3/02
Abstract: A head-mounted device (HMD) is configured to perform depth detection with a stereo camera pair comprising a first camera and a second camera, both of which are configured to detect/capture visible light and IR light. The fields of view for both of the cameras overlap to form an overlapping field of view. The HMD also includes an IR dot-pattern illuminator that is mounted on the HMD with the cameras and that is configured to emit an IR dot-pattern illumination. The IR dot-pattern illuminator emits a dot-pattern illumination that spans at least a part of the overlapping field of view. The IR dot-pattern illumination adds texture to objects in the environment and enables the HMD to determine depth for those objects, even if they have textureless/smooth surfaces.
-
公开(公告)号:US10948726B2
公开(公告)日:2021-03-16
申请号:US16593176
申请日:2019-10-04
Applicant: Microsoft Technology Licensing, LLC
Inventor: Youding Zhu , Michael Bleyer , Denis Claude Pierre Demandolx , Raymond Kirk Price
Abstract: Optimizations are provided for generating passthrough visualizations for Head Mounted Displays. The interpupil distance of a user wearing a head-mounted device is determined and a stereo camera pair with a left and right camera is used to capture raw images. The center-line perspectives of the images captured by the left camera have non-parallel alignments with respect to center-line perspectives of any images captured by the right camera. After the raw images are captured, various camera distortion corrections are applied to the images to create corrected images. Epipolar transforms are then applied to the corrected images to create transformed images having parallel center-line perspectives. Thereafter, a depth map is generated of the transformed images. Finally, left and right passthrough visualizations are generated and rendered by reprojecting the transformed left and right images.
-
公开(公告)号:US20210065392A1
公开(公告)日:2021-03-04
申请号:US16555660
申请日:2019-08-29
Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
Inventor: Michael Bleyer , Yuri Pekelny , Raymond Kirk Price
Abstract: Disclosed herein are optimized techniques for controlling the exposure time or illumination intensity of a depth sensor. Invalid-depth pixels are identified within a first depth map of an environment. For each invalid-depth pixel, a corresponding image pixel is identified in a depth image that was used to generate the first depth map. Multiple brightness intensities are identified from the depth image. Each brightness intensity is categorized as corresponding to either an overexposed or underexposed image pixel. An increased exposure time or illumination intensity or, alternatively, a decreased exposure time or illumination intensity is then used to capture another depth image of the environment. After a second depth map is generated based on the new depth image, portion(s) of the second depth map are selectively merged with the first depth map by replacing the invalid-depth pixels of the first depth map with corresponding valid-depth pixels of the second depth map.
-
公开(公告)号:US10929956B2
公开(公告)日:2021-02-23
申请号:US16460321
申请日:2019-07-02
Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
Inventor: Michael Bleyer , Christopher Douglas Edmonds , Raymond Kirk Price
Abstract: Techniques for de-aliasing depth ambiguities included within infrared phase depth images are described herein. An illuminator emits reference light towards a target object. Some of this light is reflected back and detected. A phase image is generated based on phase differences between the reference light and the reflected light. The phase differences represent changes in depth within overlapping sinusoidal periods of the reference and reflected light. The phase image also includes ambiguities because multiple different depths within the phase image share the same phase difference value, even though these depths actually correspond to different real-world depths. The phase image is fed as input to a machine learning (“ML”) component, which is configured to de-alias the ambiguities by determining, for each pixel in the phase image, a corresponding de-aliasing interval. A depth map is generated based on the phase image and any de-aliasing intervals generated by the ML component.
-
公开(公告)号:US10762219B2
公开(公告)日:2020-09-01
申请号:US15983408
申请日:2018-05-18
Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
Inventor: Yuri Pekelny , Michael Bleyer , Raymond Kirk Price
Abstract: Optimizations are provided to control access to virtual content included within a three-dimensional (3D) mesh. Specifically, after the 3D mesh is accessed, then objects represented by the 3D mesh are segmented so that they are distinguishable from one another. Once segmented, then a permissions is assigned to each object or even to groups of objects. For instance, all of the objects that are associated with a particular sub-space (e.g., a bedroom or a living room) may be assigned the same permissions. By assigning permissions to objects, it is possible to control which requesting entities will have access to the objects as well as how much access each of those requesting entities is afforded.
-
公开(公告)号:US10607083B2
公开(公告)日:2020-03-31
申请号:US16040518
申请日:2018-07-19
Applicant: Microsoft Technology Licensing, LLC
Inventor: Yuri Pekelny , Michael Bleyer , Michelle Lynn Brook
Abstract: A computer-implemented technique is described herein for discriminatively apprising the user of the existence of some, but not necessarily all, physical objects in a physical environment in the course of the user's interaction with a virtual environment. In operation, the technique allows the user to selectively identify one or more objects-of-interest, such as people, walls, computing devices, etc. The technique then uses a scene analysis component to automatically detect the presence of the selected objects-of-interest in the physical environment, while the user interacts with the virtual environment. The technique provides alert information which notifies the user of the existence of any objects-of-interest that it detects. By virtue of the above-summarized strategy, the technique can apprise the user of objects-of-interest in the user's vicinity without cluttering the user's virtual experience with extraneous information pertaining to the physical environment.
-
公开(公告)号:US10560679B2
公开(公告)日:2020-02-11
申请号:US15252129
申请日:2016-08-30
Applicant: Microsoft Technology Licensing, LLC
Inventor: Jian Zhao , Michael Bleyer , Raymond Kirk Price , Denis Demandolx
Abstract: Disclosed are an apparatus and a method for detecting deformation of a structured light depth imaging system and automatic re-calibration for the depth imaging system. In one embodiment, a depth imaging device includes a light projector, a camera and a processor. The light projector emits light corresponding to a projected pattern image having a plurality of features with known locations in the projected pattern image. The camera captures the light reflected by an environment of the depth imaging device and generates a reflected pattern image as a two-dimensional (2D) projection of the environment. The reflected pattern image includes a plurality of features that correspond to the features of the projected pattern image. The processor detects a misalignment for a distance or an orientation between the light projector and the camera based on a relationship between the features in the projected pattern image and the features in the reflected pattern image.
-
-
-
-
-
-
-
-
-