-
公开(公告)号:US20220021860A1
公开(公告)日:2022-01-20
申请号:US16928162
申请日:2020-07-14
Applicant: Microsoft Technology Licensing, LLC
Inventor: Michael BLEYER , Christopher Douglas EDMONDS , Raymond Kirk PRICE
IPC: H04N13/128 , G03B35/18
Abstract: Techniques for aligning and stabilizing images generated by an integrated stereo camera pair with images generated by a detached camera are disclosed. A first image is generated using a first stereo camera; a second image is generated using a second stereo camera; and a third image is generated using the detached camera. A first rotation base matrix is computed between the third and first images, and a second rotation base matrix is computed between the third and second images. The third image is aligned to the first image using the first rotation base matrix, and the third image is aligned to the second image using the second rotation base matrix. A first overlaid image is generated by overlaying the third image onto the first image, and a second overlaid image is generated by overlaying the third image onto the second image. The two overlaid images are parallax corrected and displayed.
-
公开(公告)号:US20220020168A1
公开(公告)日:2022-01-20
申请号:US17340455
申请日:2021-06-07
Applicant: Microsoft Technology Licensing, LLC
Inventor: Raymond Kirk PRICE , Michael BLEYER , Christopher Douglas EDMONDS
IPC: G06T7/73 , G06T7/80 , G06T7/593 , H04N13/344 , H04N13/296 , H04N13/239
Abstract: Techniques for aligning images generated by an integrated camera physically mounted to an HMD with images generated by a detached camera physically unmounted from the HMD are disclosed. A 3D feature map is generated and shared with the detached camera. Both the integrated camera and the detached camera use the 3D feature map to relocalize themselves and to determine their respective 6 DOF poses. The HMD receives the detached camera's image of the environment and the 6 DOF pose of the detached camera. A depth map of the environment is accessed. An overlaid image is generated by reprojecting a perspective of the detached camera's image to align with a perspective of the integrated camera and by overlaying the reprojected detached camera's image onto the integrated camera's image.
-
公开(公告)号:US20210383144A1
公开(公告)日:2021-12-09
申请号:US16895979
申请日:2020-06-08
Applicant: Microsoft Technology Licensing, LLC
Inventor: Raymond Kirk PRICE , Michael BLEYER , Evan Gregory LEVINE
IPC: G06K9/03 , G06K9/00 , G06K9/20 , G06F16/909 , G01S19/48
Abstract: A method of automatically geolocating a visual target. The method comprises operating a flying vehicle in a search region including the visual target. The method further includes affirmatively identifying a visual target in an aerial photograph of the search region captured by the flying vehicle. The method further includes automatically correlating the aerial photograph of the search region to a geo-tagged photograph of the search region, wherein the geo-tagged photograph is labelled with pre-defined geospatial coordinates. Based on such automatic correlation, a geospatial coordinate is determined for the visual target in the search region.
-
公开(公告)号:US20200334824A1
公开(公告)日:2020-10-22
申请号:US16917255
申请日:2020-06-30
Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
Inventor: Michael BLEYER , Yuri PEKELNY , Raymond Kirk PRICE
Abstract: Techniques are provided to dynamically generate and render an object bounding fence in a mixed-reality scene. Initially, a sparse spatial mapping is accessed. The sparse spatial mapping beneficially includes perimeter edge data describing an object's edge perimeters. A gravity vector is also generated. Based on the perimeter edge data and the gravity vector, two-dimensional (2D) boundaries of the object are determined and a bounding fence mesh of the environment is generated. A virtual object is then rendered, where the virtual object is representative of at least a portion of the bounding fence mesh and visually illustrates a bounding fence around the object.
-
公开(公告)号:US20190384388A1
公开(公告)日:2019-12-19
申请号:US16552338
申请日:2019-08-27
Applicant: Microsoft Technology Licensing, LLC
Inventor: Raymond Kirk PRICE , Michael BLEYER , Denis DEMANDOLX
Abstract: A method for active eye-tracking comprises pulsing on and off a plurality of infrared optical sources configured to emit infrared light with a narrow spectral linewidth toward an eye of a user, such that a pulse-on duration is less than a duration needed to fully thermalize each optical source. One or more shuttered optical sensors are configured to receive infrared light reflected off the eye of the user. The shuttered optical sensors are opened for a detection duration based on the pulse-on duration, the shuttered optical sensors. A conformation of the user's eye is indicated based on infrared light received at the shuttered optical sensor during the detection duration.
-
公开(公告)号:US20240365012A1
公开(公告)日:2024-10-31
申请号:US18306727
申请日:2023-04-25
Applicant: Microsoft Technology Licensing, LLC
Abstract: A system for facilitating dark current compensation by weighted filtering is configurable to (i) receive an input dark current image; (ii) generate a corrected dark current image at least by scaling pixel values of the input dark current image based upon ambient light conditions; and generate a weight map comprising a weight value for each pixel of the corrected dark current image. For each pixel of the corrected dark current image, the weight value of the weight map may be based upon a light level of the pixel of the corrected dark current image. The system is also configurable to generate an output image by utilizing the weight map to filter an input image.
-
公开(公告)号:US20240276107A1
公开(公告)日:2024-08-15
申请号:US18627616
申请日:2024-04-05
Applicant: Microsoft Technology Licensing, LLC
Inventor: Raymond Kirk PRICE , Michael BLEYER , Christopher Douglas EDMONDS
IPC: H04N23/81 , G01S7/4914 , G02B27/01 , G06T7/20 , G06T7/593 , H01L27/146 , H04N13/239 , H04N13/254
CPC classification number: H04N23/81 , G02B27/0172 , G06T7/20 , G06T7/593 , H04N13/239 , H04N13/254 , G01S7/4914 , G02B2027/0138 , G02B2027/014 , G02B2027/0178 , H01L27/14643 , H01L27/14665
Abstract: An HMD includes a single photon avalanche diode (SPAD) array comprising a plurality of SPAD pixels. The HMD also includes a display positioned to display images for viewing by an eye of a user. The HMD also includes one or more processors and one or more hardware storage devices storing instructions that are executable by the one or more processors to configure the HMD to perform various acts associated with using the SPAD array to capture an image frame of an environment for display to the user.
-
公开(公告)号:US20240144496A1
公开(公告)日:2024-05-02
申请号:US17978463
申请日:2022-11-01
Applicant: Microsoft Technology Licensing, LLC
Inventor: Paul LEE , Michael BLEYER , Christian Markus MAEKELAE
CPC classification number: G06T7/33 , G06T11/00 , G06T2207/20221
Abstract: Techniques for performing image alignment between a first image generated by a first camera and a second image generated by a second camera are disclosed. The image alignment is performed using staggered feature extraction in which a set of features are reused to align the second image with the first image. A first set of features are identified from within the first image, and a second set of features, which were previously detected within the second image, are accessed. The second set of features were previously used at least once to perform a previous image alignment operation. A current image alignment operation is performed by using the first set of features and by reusing the second set of features to align the first image with the second image.
-
公开(公告)号:US20240056696A1
公开(公告)日:2024-02-15
申请号:US18494592
申请日:2023-10-25
Applicant: Microsoft Technology Licensing, LLC
Inventor: Raymond Kirk PRICE , Michael BLEYER , Christopher Douglas EDMONDS
IPC: H04N25/671 , G06T5/00
CPC classification number: H04N25/671 , G06T5/002
Abstract: An image sensor configured to capture imagery with mitigated noise includes a plurality of image sensing pixels arranged to form a sensor array. Each image sensing pixel of the plurality of image sensing pixels comprises an active area configured to receive photons to facilitate image capture. Each active area comprises a length and a width. For at least one image sensing pixel of the plurality of image sensing pixels, the length or the width of the active area is smaller than about 80% of a pixel pitch measurement between the at least one image sensing pixel and an adjacent image sensing pixel. A size of the active area relative to the pixel pitch measurement contributes to mitigating sensor noise for the image sensor.
-
公开(公告)号:US20240029206A1
公开(公告)日:2024-01-25
申请号:US18375879
申请日:2023-10-02
Applicant: Microsoft Technology Licensing, LLC
Inventor: Raymond Kirk PRICE , Michael BLEYER , Christopher Douglas EDMONDS
CPC classification number: G06T5/50 , G06T7/13 , G06T7/33 , G06T3/40 , G06T5/002 , G06T7/40 , H04N5/265 , H04N23/90 , G06T2207/10024 , G06T2207/10048 , G06T2207/20221
Abstract: Techniques for generating a fused enhanced image. A first image is generated using a first camera of a first modality, and a second image is generated using a second camera of a second modality. Pixels that are common between the two images are identified. Textures for the common pixels are determined. A camera characteristic, which is linked to noise, is identified. A scaling factor is applied to the textures in the first image. A first saliency is determined using the scaled textures. A second saliency is determined using the textures from the second image. An alpha map is generated and reflects edge detection weights that have been computed for each one of the common pixels based on the two saliencies. Based on the alpha map, textures are merged from the common pixels to generate the fused enhanced image.
-
-
-
-
-
-
-
-
-