-
公开(公告)号：US12177496B2
公开(公告)日：2024-12-24
申请号：US18482654
申请日：2023-10-06
Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
Inventor： Raymond Kirk Price , Michael Bleyer , Christopher Douglas Edmonds
IPC: H04N21/234 , G06T3/4053 , H04N21/2343 , H04N21/242 , H04N23/68 , H04N23/90
Abstract: A system for generating high-resolution video from low-resolution images is configured to access a first video stream and a second video stream capturing an environment. The first video stream is captured by a first video capture device. The second video stream is captured by a second video capture device. Image frames of the first video stream are temporally synchronized with corresponding image frames of the second video stream. The system is also configured to generate a composite video stream with a higher resolution than the first or second video streams. Each composite image frame of the composite video stream is generated using a respective image frame of the first video stream and a temporally synchronized corresponding image frame of the second video stream as input.
-
2.发明授权公开(公告)号：US12096145B2
公开(公告)日：2024-09-17
申请号：US18299201
申请日：2023-04-12
Applicant: Microsoft Technology Licensing, LLC
Inventor： Raymond Kirk Price , Michael Bleyer , Christopher Douglas Edmonds
IPC: H04N25/705 , G02B27/01
CPC classification number: H04N25/705 , G02B27/0172 , G02B2027/0138
Abstract: A system for structured light depth computation using single photon avalanche diodes (SPADs) is configurable to, over a frame capture time period, selectively activate the illuminator to perform interleaved structured light illumination operations. The interleaved structured light illumination operations comprise alternately emitting at least a first structured light pattern from the illuminator and emitting at least a second structured light pattern from the illuminator. The system is also configurable to, over the frame capture time period, perform a plurality of sequential shutter operations to configure each SPAD pixel of the SPAD array to enable photon detection. The plurality of sequential shutter operations generates, for each SPAD pixel of the SPAD array, a plurality of binary counts indicating whether a photon was detected during each of the plurality of sequential shutter operations.
-
公开(公告)号：US12079969B2
公开(公告)日：2024-09-03
申请号：US17230518
申请日：2021-04-14
Applicant: Microsoft Technology Licensing, LLC
Inventor： Raymond Kirk Price , Michael Bleyer , Christopher Douglas Edmonds
CPC classification number: G06T5/77 , G02B27/0172 , G06T3/40 , G06T5/20 , G06T5/50 , G06T7/13 , G06T7/174 , G06T7/40 , G06T2207/20024 , G06T2207/20084
Abstract: Techniques for generating an enhanced image. A first image is generated using a camera of a first modality, and a second image is generated using a camera of a second modality. Pixels that are common between the two images are identified. An alpha map is generated. The alpha map reflects edge detection weights that are computed for the common pixels based on saliency values. A determination is made as to how much texture from the images to use to generate an enhanced image. This determination is based on the edge detection weights included within the alpha map. Based on the edge detection weights, textures are merged from the common pixels to generate the enhanced image. Color is also added to the enhanced image, where the color reflects an additional property (e.g., the texture source for the pixel) that is associated with one or both of the images.
-
公开(公告)号：US12075020B2
公开(公告)日：2024-08-27
申请号：US17981781
申请日：2022-11-07
Applicant: Microsoft Technology Licensing, LLC
Inventor： Michael Bleyer , Yuri Pekelny , Raymond Kirk Price
IPC: H04N13/271 , G06F3/01 , G06F3/0346 , G06T7/593 , G06T15/04 , G06T19/00 , G09G3/02 , H04N5/33 , H04N13/239 , H04N13/254 , G02B27/01 , H04N13/00
CPC classification number: H04N13/271 , G06F3/012 , G06F3/0346 , G06T7/593 , G06T15/04 , G06T19/006 , G09G3/025 , H04N5/33 , H04N13/239 , H04N13/254 , G02B2027/0138 , G02B2027/014 , G06T2207/10048 , H04N2013/0081
Abstract: A head-mounted device (HMD) is configured to perform depth detection with a stereo camera pair comprising a first camera and a second camera, both of which are configured to detect/capture visible light and IR light. The fields of view for both of the cameras overlap to form an overlapping field of view. The HMD also includes an IR dot-pattern illuminator that is mounted on the HMD with the cameras and that is configured to emit an IR dot-pattern illumination. The IR dot-pattern illuminator emits a dot-pattern illumination that spans at least a part of the overlapping field of view. The IR dot-pattern illumination adds texture to objects in the environment and enables the HMD to determine depth for those objects, even if they have textureless/smooth surfaces.
-
公开(公告)号：US12063342B2
公开(公告)日：2024-08-13
申请号：US18320055
申请日：2023-05-18
Applicant: Microsoft Technology Licensing, LLC
Inventor： Raymond Kirk Price , Michael Bleyer , Christopher Douglas Edmonds
IPC: H04N13/271 , G06T7/593 , H04N13/254 , H04N23/72
CPC classification number: H04N13/271 , G06T7/593 , H04N13/254 , H04N23/72 , G06T2207/20081
Abstract: A system is configurable to, over a frame capture time period, selectively activate an illuminator to alternately emit light from the illuminator and refrain from emitting light from the illuminator. The system is configurable to, over the frame capture time period, perform a plurality of sequential shutter operations to configure each image sensor pixel of an image sensor array to enable photon detection. The plurality of sequential shutter operations generates, for each image sensor pixel of the image sensor array, a plurality of binary counts indicating whether a photon was detected during each of the plurality of sequential shutter operations. The system is configurable to, based on a first set of binary counts of the plurality of binary counts, generate an ambient light image. The system is configurable to, based on a second set of binary counts of the plurality of binary counts, generate an illuminated image.
-
Patent Agency Ranking
公开(公告)号：US12020448B2
公开(公告)日：2024-06-25
申请号：US18296559
申请日：2023-04-06
Applicant: Microsoft Technology Licensing, LLC
Inventor： Michael Bleyer , Christopher Douglas Edmonds , Dominik Alexander Konik , Raymond Kirk Price
CPC classification number: G06T7/337 , G02B27/0189 , G06T7/80 , G02B2027/0198
Abstract: A system for updating continuous image alignment of separate cameras identifies a previous alignment matrix associated with a previous frame pair captured at one or more previous timepoints by a reference camera and a match camera. The previous alignment matrix is based on visual correspondences in the previous frame pair. The system also identifies a current matrix associated with a current frame pair captured at one or more current timepoints by the reference camera and the match camera. The current matrix is based on visual correspondences in the current frame pair. The system also identifies a difference value associated with the reference camera or the match camera relative to the one or more previous timepoints and the one or more current timepoints. The system also generates an updated alignment matrix by using the previous alignment matrix, the current matrix, and the difference value as inputs.
-
7.发明授权公开(公告)号：US11962922B2
公开(公告)日：2024-04-16
申请号：US18318533
申请日：2023-05-16
Applicant: Microsoft Technology Licensing, LLC
Inventor： Raymond Kirk Price , Michael Bleyer , Christopher Douglas Edmonds
Abstract: A system for dark current compensation in SPAD imagery is configurable to capture an image frame with the SPAD array and generate a temporally filtered image by performing a temporal filtering operation using the image frame and at least one preceding image frame. The at least one preceding image frame is captured by the SPAD array at a timepoint that temporally precedes a timepoint associated with the image frame. The system is also configurable to obtain a dark current image frame. The dark current image frame includes data indicating one or more SPAD pixels of the plurality of SPAD pixels that detect an avalanche event without detecting a corresponding photon. The system is also configurable to generate a dark current compensated image by performing a subtraction operation on the temporally filtered image or the image frame based on the dark current image frame.
-
公开(公告)号：US11899211B2
公开(公告)日：2024-02-13
申请号：US17357855
申请日：2021-06-24
Applicant: Microsoft Technology Licensing, LLC
Inventor： Raymond Kirk Price , Michael Bleyer , Christopher Douglas Edmonds
CPC classification number: G02B27/0172 , G02B6/005 , G02B6/0023 , G09G3/02 , G09G3/2081 , G09G3/3413 , H01S5/0425 , H01S5/0428 , G02B2027/014 , G02B2027/0118 , G02B2027/0123 , G02B2027/0178
Abstract: A near-eye display device comprises a pupil-expansion optic, a laser, a drive circuit coupled operatively to the first and second lasers, a spatial light modulator (SLM), and a computer. The SLM has a matrix of electronically controllable pixel elements and is configured to receive emission from the laser and to direct the emission in spatially modulated form to the pupil-expansion optic. Coupled operatively to the drive circuit and to the SLM, the computer is configured to parse a digital image, trigger the emission from the laser by causing the drive circuit to drive a periodic current through a gain structure of the laser, and control the matrix of pixel elements such that the spatially modulated form of the emission projects an optical image corresponding to the digital image, wherein the periodic current includes plural cycles of modulation driven through the gain structure while the optical image is projected.
-
公开(公告)号：US11849220B2
公开(公告)日：2023-12-19
申请号：US17230813
申请日：2021-04-14
Applicant: Microsoft Technology Licensing, LLC
Inventor： Michael Bleyer , Christopher Douglas Edmonds , Antonios Matakos , Raymond Kirk Price
CPC classification number: H04N23/682 , G06T3/4076 , G06T7/55 , H04N23/689
Abstract: A system for generating depth information from low-resolution images is configured to access a plurality of image frames capturing an environment, identify a first group of image frames from the plurality of image frames, and generate a first image comprising a first composite image of the environment using the first group of image frames as input. The first composite image has an image resolution that is higher than an image resolution of the image frames of the first group of image frames. The system is also configured to obtain a second image of the environment, where parallax exists between a capture perspective associated with the first image and a capture perspective associated with the second image. The system is also configured to generate depth information for the environment based on the first image and the second image.
-
公开(公告)号：US11810278B2
公开(公告)日：2023-11-07
申请号：US17306681
申请日：2021-05-03
Applicant: Microsoft Technology Licensing, LLC
Inventor： Raymond Kirk Price , Michael Bleyer , Christopher Douglas Edmonds
CPC classification number: G06T5/50 , G06T3/40 , G06T5/002 , G06T7/13 , G06T7/33 , G06T7/40 , H04N5/265 , H04N23/90 , G06T2207/10024 , G06T2207/10048 , G06T2207/20221
Abstract: Techniques for generating a fused enhanced image. A first image is generated using a first camera of a first modality, and a second image is generated using a second camera of a second modality. Pixels that are common between the two images are identified. Textures for the common pixels are determined. A camera characteristic, which is linked to noise, is identified. A scaling factor is applied to the textures in the first image. A first saliency is determined using the scaled textures. A second saliency is determined using the textures from the second image. An alpha map is generated and reflects edge detection weights that have been computed for each one of the common pixels based on the two saliencies. Based on the alpha map, textures are merged from the common pixels to generate the fused enhanced image.
-
-
-
-
-
-
-
-
-
Search Results
223
records
(took 0.033 seconds)
