-
公开(公告)号:US20240404011A1
公开(公告)日:2024-12-05
申请号:US18325437
申请日:2023-05-30
Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
Abstract: A system for facilitating tone mapping is configurable to (i) generate an input image histogram based on one or more input images, the input image histogram comprising a plurality of bins, wherein each bin of the plurality of bins is associated with one or more pixel values and indicates a quantity of pixels that comprise the one or more pixel values; (ii) generate a target histogram based at least on the input image histogram; and (iii) generate an output image by using the target histogram to map pixel values of at least one of the one or more input images to corresponding pixel values in the output image.
-
公开(公告)号:US20240380913A1
公开(公告)日:2024-11-14
申请号:US18314370
申请日:2023-05-09
Applicant: Microsoft Technology Licensing, LLC
Abstract: A system for facilitating motion compensation is configurable to access an affine transformation-compensated image. The affine transformation-compensated image is generated by applying affine transformation-based motion compensation to a previous image. The system is further configurable to generate a motion-compensated image by applying optical flow-based motion compensation to the affine transformation-compensated image. The optical flow-based motion compensation utilizes the affine transformation-compensated image and a current image as inputs.
-
3.
公开(公告)号:US20240354982A1
公开(公告)日:2024-10-24
申请号:US18763581
申请日:2024-07-03
Applicant: Microsoft Technology Licensing, LLC
Inventor: Raymond Kirk PRICE , Michael BLEYER , Christopher Douglas EDMONDS
CPC classification number: G06T7/593 , G02B27/017 , G06T3/40 , G06T5/20 , G06T5/50 , G06T2207/10012 , G06T2207/10048 , G06T2207/20028
Abstract: A system for low compute high-resolution depth map generation using low-resolution cameras is configured to obtain a stereo pair of images and generate a depth map by performing stereo matching on the stereo pair of images. The system is also configured to obtain a first image comprising first texture information for the environment that has a first image resolution that is higher than an image resolution of images of the stereo pair of images. The system is further configured to generate a reprojected first image by reprojecting the first image to correspond to an image capture perspective associated with the depth map. The reprojection of the first image is based on depth information from the depth map and includes reprojected first texture information for the environment. The system is also configured to generate an upsampled depth map based on the depth map.
-
4.
公开(公告)号:US20240251182A1
公开(公告)日:2024-07-25
申请号:US18596359
申请日:2024-03-05
Applicant: Microsoft Technology Licensing, LLC
Inventor: Raymond Kirk PRICE , Michael BLEYER , Christopher Douglas EDMONDS
Abstract: A system for dark current compensation in SPAD imagery is configurable to capture an image frame with the SPAD array and generate a temporally filtered image by performing a temporal filtering operation using the image frame and at least one preceding image frame. The at least one preceding image frame is captured by the SPAD array at a timepoint that temporally precedes a timepoint associated with the image frame. The system is also configurable to obtain a dark current image frame. The dark current image frame includes data indicating one or more SPAD pixels of the plurality of SPAD pixels that detect an avalanche event without detecting a corresponding photon. The system is also configurable to generate a dark current compensated image by performing a subtraction operation on the temporally filtered image or the image frame based on the dark current image frame.
-
公开(公告)号:US20240242327A1
公开(公告)日:2024-07-18
申请号:US18618961
申请日:2024-03-27
Applicant: Microsoft Technology Licensing, LLC
Inventor: Michael BLEYER , Raymond Kirk PRICE , Christopher Douglas EDMONDS
CPC classification number: G06T7/0002 , G02B27/0172 , G06T7/97 , G06T19/006 , G02B2027/0138 , G02B2027/014 , G06T2207/30168
Abstract: Techniques for evaluating multiple images, which originate from multiple different sources, and for selecting specific images to generate an overlaid image are disclosed. A first set of system camera images (e.g., based on a first FPS rate) and a second set of external camera images (e.g., based on a second FPS rate) are obtained. A set of rules are accessed in order to govern a selection process for selecting a specific system camera image and a specific external camera image. The selected images are designated for use in generating an overlaid image. The selection process is performed using the accessed set of rules. The overlaid image is generated by overlaying and aligning content obtained from the selected images.
-
公开(公告)号:US20240073523A1
公开(公告)日:2024-02-29
申请号:US18502980
申请日:2023-11-06
Applicant: Microsoft Technology Licensing, LLC
Inventor: Michael BLEYER , Christopher Douglas EDMONDS , Antonios MATAKOS , Raymond Kirk PRICE
CPC classification number: H04N23/682 , G06T3/4076 , G06T7/55 , H04N23/689
Abstract: A system for generating depth information from low-resolution images is configured to access a plurality of image frames capturing an environment, identify a first group of image frames from the plurality of image frames, and generate a first image comprising a first composite image of the environment using the first group of image frames as input. The first composite image has an image resolution that is higher than an image resolution of the image frames of the first group of image frames. The system is also configured to obtain a second image of the environment, where parallax exists between a capture perspective associated with the first image and a capture perspective associated with the second image. The system is also configured to generate depth information for the environment based on the first image and the second image.
-
公开(公告)号:US20230300483A1
公开(公告)日:2023-09-21
申请号:US18324805
申请日:2023-05-26
Applicant: Microsoft Technology Licensing, LLC
Inventor: Raymond Kirk PRICE , Michael BLEYER , Christopher Douglas EDMONDS
IPC: H04N25/702 , G06T3/40 , G06T5/20 , H04N9/64 , H04N23/84
CPC classification number: H04N25/702 , G06T3/4015 , G06T5/20 , H04N9/646 , H04N23/843 , G06T2207/20028 , H04N2209/042
Abstract: A system for obtaining color imagery using SPADs includes a SPAD array that has a plurality of SPAD pixels. Each of the plurality of SPAD pixels includes a respective color filter positioned thereover. The system is configurable to capture an image frame using the SPAD array and generate a filtered image by performing a temporal filtering operation using the image frame and at least one preceding image frame. The at least one preceding image frame is captured by the SPAD array at a timepoint that temporally precedes a timepoint associated with the image frame. The system is also configurable to, after performing the temporal filtering operation, generate a color image by demosaicing the filtered image.
-
公开(公告)号:US20230291887A1
公开(公告)日:2023-09-14
申请号:US18320055
申请日:2023-05-18
Applicant: Microsoft Technology Licensing, LLC
Inventor: Raymond Kirk PRICE , Michael BLEYER , Christopher Douglas EDMONDS
IPC: H04N13/271 , G06T7/593 , H04N13/254 , H04N23/72
CPC classification number: H04N13/271 , G06T7/593 , H04N13/254 , H04N23/72 , G06T2207/20081
Abstract: A system is configurable to, over a frame capture time period, selectively activate an illuminator to alternately emit light from the illuminator and refrain from emitting light from the illuminator. The system is configurable to, over the frame capture time period, perform a plurality of sequential shutter operations to configure each image sensor pixel of an image sensor array to enable photon detection. The plurality of sequential shutter operations generates, for each image sensor pixel of the image sensor array, a plurality of binary counts indicating whether a photon was detected during each of the plurality of sequential shutter operations. The system is configurable to, based on a first set of binary counts of the plurality of binary counts, generate an ambient light image. The system is configurable to, based on a second set of binary counts of the plurality of binary counts, generate an illuminated image.
-
公开(公告)号:US20230274401A1
公开(公告)日:2023-08-31
申请号:US17682315
申请日:2022-02-28
Applicant: Microsoft Technology Licensing, LLC
Inventor: Raymond Kirk PRICE , Michael BLEYER , Christopher Douglas EDMONDS
CPC classification number: G06T5/50 , G06V10/62 , G06T7/223 , G06V10/30 , G06T2207/20216
Abstract: Techniques for generating a temporally filtered image designed to compensate for global motions of a camera and to compensate for local motions of an object are disclosed. A history frame and a current frame are acquired. A global motion compensation operation is performed on the history frame to reproject a pose of the history frame to match the pose of the current frame. The history frame is compared against the current frame to identify pixels that represent moving objects. For each of those pixels, an optical flow vector is computed. The optical flow vectors are then applied to those pixels to shift those pixels to new locations. These new positions, which are in the history frame, correspond to positions that were identified in the current frame. Afterwards, the current frame is temporally filtered with the history frame.
-
公开(公告)号:US20230260204A1
公开(公告)日:2023-08-17
申请号:US18128322
申请日:2023-03-30
Applicant: Microsoft Technology Licensing, LLC
CPC classification number: G06T15/205 , G06T7/33 , G06T7/97
Abstract: Techniques for aligning images generated by two cameras are disclosed. This alignment is performed by computing a relative 3D orientation between the two cameras. A first gravity vector for a first camera and a second gravity vector for a second camera are determined. A first camera image is obtained from the first camera, and a second camera image is obtained from the second camera. A first alignment process is performed to partially align the first camera’s orientation with the second camera’s orientation. This process is performed by aligning the gravity vectors, thereby resulting in two degrees of freedom of the relative 3D orientation being eliminated. Visual correspondences between the two images are identified. A second alignment process is performed to fully align the orientations. This process is performed by using the identified visual correspondences to identify and eliminate a third degree of freedom of the relative 3D orientation.
-
-
-
-
-
-
-
-
-