-
公开(公告)号:US20220189043A1
公开(公告)日:2022-06-16
申请号:US17122661
申请日:2020-12-15
Applicant: Microsoft Technology Licensing, LLC
Inventor: Michael BLEYER , Christopher Douglas EDMONDS , Raymond Kirk PRICE
Abstract: Examples are described that relate to correcting line bias in images. One example provides a method comprising receiving, from an imaging device, a plurality of images each comprising a plurality of lines of pixels. The method further comprises, for each image of the plurality of images, for each line of pixels of the plurality of lines of pixels, based at least on one or more pixel values of one or more pixels in the line of pixels, determining a line bias correction for the line, and applying the line bias correction to each pixel in the line, the line bias correction comprising an offset applied to each pixel value in the line of pixels.
-
公开(公告)号:US20220171187A1
公开(公告)日:2022-06-02
申请号:US17108673
申请日:2020-12-01
Applicant: Microsoft Technology Licensing, LLC
Abstract: Techniques for updating a position of overlaid image content using IMU data to reflect subsequent changes in camera positions to minimize latency effects are disclosed. A “system camera” refers to an integrated camera that is a part of an HMD. An “external camera” is a camera that is separated from the HMD. The system camera and the external camera generate images. These images are overlaid on one another and aligned to form an overlaid image. Content from the external camera image is surrounded by a bounding element in the overlaid image. IMU data associated with both the system camera and the external camera is obtained. Based on that IMU data, an amount of movement that the system camera and/or the external camera have moved since the images were originally generated is determined. Based on that movement, the bounding element is shifted to a new position in the overlaid image.
-
公开(公告)号:US20220164969A1
公开(公告)日:2022-05-26
申请号:US17666747
申请日:2022-02-08
Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
Inventor: Raymond Kirk PRICE , Michael BLEYER , Christopher Douglas EDMONDS
IPC: G06T7/33 , G06T7/593 , H04N13/156 , H04N13/239 , H04N13/25 , H04N13/133
Abstract: Modifications are performed to cause a style of an image to match a different style. A first image is accessed, where the first image has the first style. A second image is also accessed, where the second image has a second style. Subsequent to a deep neural network (DNN) learning these styles, a copy of the first image is fed as input to the DNN. The DNN modifies the first image copy by transitioning the first image copy from being of the first style to subsequently being of the second style. As a consequence, a modified style of the transitioned first image copy bilaterally matches the second style.
-
公开(公告)号:US20220084290A1
公开(公告)日:2022-03-17
申请号:US17356329
申请日:2021-06-23
Applicant: Microsoft Technology Licensing, LLC
Inventor: Raymond Kirk PRICE , Michael BLEYER , Christopher Douglas EDMONDS
Abstract: Systems are configured for performing GPS-based and sensor-based relocalization. During the relocalization, the systems are configured to obtain radio-based positioning data indicating an estimated position of the system within a mapped environment. The systems are also configured to identify, based on the estimated position, a subset of keyframes of a map of the mapped environment, wherein the map of the mapped environment includes a plurality of keyframes captured from a plurality of locations within the mapped environment, and the plurality of keyframes are associated with anchor points identified within the mapped environment. The systems are further configured to perform relocalization within the mapped environment based on the subset of keyframes.
-
公开(公告)号:US20220028094A1
公开(公告)日:2022-01-27
申请号:US16936365
申请日:2020-07-22
Applicant: Microsoft Technology Licensing, LLC
Inventor: Michael BLEYER , Christopher Douglas EDMONDS , Raymond Kirk PRICE
Abstract: A system for facilitating the identifying of correspondences between images experiencing motion blur obtains a reference frame captured by a reference camera at a reference camera and obtains a match frame captured by a match camera at a match camera timepoint. The system identifies a motion attribute that includes (1) a reference camera motion attribute associated with the reference camera at the reference camera timepoint, and/or (2) a match camera motion attribute associated with the match camera at the match camera timepoint. The system determines a downsampling resolution using at least as inputs at least one of: the motion attribute, a camera exposure time, a camera field of view, or a camera angular resolution. The system generates a downsampled reference frame and a downsampled match frame based on the downsampling resolution. The system identifies correspondences between the downsampled reference frame and the downsampled match frame.
-
公开(公告)号:US20210400185A1
公开(公告)日:2021-12-23
申请号:US16904120
申请日:2020-06-17
Applicant: Microsoft Technology Licensing, LLC
Inventor: Raymond Kirk PRICE , Christopher Douglas EDMONDS , Michael BLEYER , Donald John Patrick O'NEIL
Abstract: One aspect of this disclosure includes a method for operating a head-mounted display system that includes an imaging device. The method includes receiving an indication that an ambient light condition in an environment is below a lighting threshold. Responsive to the low lighting condition, an amount of motion of the head-mounted display relative to the environment is determined based on one or more signals received from an inertial measurement unit included in the head-mounted display system. An exposure time, frame rate, and a pixel-binning mode are automatically selected for the imaging device based on the determined amount of motion. Imagery is captured from the environment using the automatically selected exposure time, frame rate, and pixel-binning mode for the imaging device. The captured imagery is then displayed at the head-mounted display system.
-
公开(公告)号:US20210160441A1
公开(公告)日:2021-05-27
申请号:US17091131
申请日:2020-11-06
Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
Inventor: Michael BLEYER , Christopher Douglas EDMONDS , Raymond Kirk PRICE
IPC: H04N5/33 , G06T19/00 , H04N13/254 , G06T7/593 , G02B27/01 , H04N5/225 , H04N13/239
Abstract: Enhanced passthrough images are generated and displayed. A current visibility condition of an environment is determined. Based on the current visibility condition, a first camera or a second camera, which detect light spanning different ranges of illuminance, is selected to generate a passthrough image of the environment. The selected camera is then caused to generate the passthrough image. Additionally, a third camera, which is structured to detect long wave infrared radiation, is caused to generate a thermal image of the environment. Parallax correction is performed by aligning coordinates of the thermal image with corresponding coordinates identified within the passthrough image. Subsequently, the parallax-corrected thermal image is overlaid onto the passthrough image to generate a composite passthrough image, which is then displayed.
-
公开(公告)号:US20200226765A1
公开(公告)日:2020-07-16
申请号:US16299076
申请日:2019-03-11
Applicant: Microsoft Technology Licensing, LLC
Inventor: Erroll William WOOD , Michael BLEYER , Christopher Douglas EDMONDS , Michael Scott FENTON , Mark James FINOCCHIO , John Albert JUDNICH
Abstract: A method to identify one or more depth-image segments that correspond to a predetermined object type is enacted in a depth-imaging controller operatively coupled to an optical time-of-flight (ToF) camera; it comprises: receiving depth-image data from the optical ToF camera, the depth-image data exhibiting an aliasing uncertainty, such that a coordinate (X, Y) of the depth-image data maps to a periodic series of depth values {Zk}; and labeling, as corresponding to the object type, one or more coordinates of the depth-image data exhibiting the aliasing uncertainty.
-
公开(公告)号:US20250104244A1
公开(公告)日:2025-03-27
申请号:US18473164
申请日:2023-09-22
Applicant: Microsoft Technology Licensing, LLC
Inventor: Yanwei WANG , Pascal PARE , Christopher Douglas EDMONDS , Mark Anthony PLAGGE , Miguel SUSFFALICH , Anuj Bharat GOSALIA
Abstract: Digital image processing methods performed by a computer are disclosed. In one example, a first digital image captured by a real camera is sub-divided into a first plurality of sub-images. A second digital image captured by a real camera is sub-divided into a second plurality of sub-images. A set of image features in a first sub-image of the first plurality of sub-images is identified. A subset of neighboring sub-images is identified from the second plurality of sub-images based at least on each neighboring sub-image of the subset of neighboring sub-images having one or more corresponding image features in common with the set of image features identified in the first sub-image.
-
公开(公告)号:US20250104203A1
公开(公告)日:2025-03-27
申请号:US18473166
申请日:2023-09-22
Applicant: Microsoft Technology Licensing, LLC
Inventor: Yanwei WANG , Pascal PARE , Christopher Douglas EDMONDS , Mark Anthony PLAGGE , Miguel SUSFFALICH , Anuj Bharat GOSALIA
Abstract: Digital image processing methods performed by a computer are disclosed. In one example, a digital image captured by a real camera having intrinsic and extrinsic parameters is received. One or more distortion correction transformations are applied to the digital image to generate a distortion-corrected digital image. The distortion-corrected digital image is sub-divided into a plurality of distortion-corrected sub-images. For each distortion-corrected sub-image of the plurality of distortion-corrected sub-images, the distortion-corrected sub-image is associated with a synthesized recapture camera having synthesized intrinsic and extrinsic parameters mapped from the intrinsic and extrinsic parameters of the real camera.
-
-
-
-
-
-
-
-
-