-
公开(公告)号:US20190012835A1
公开(公告)日:2019-01-10
申请号:US15643494
申请日:2017-07-07
Applicant: Microsoft Technology Licensing, LLC
Inventor: Michael BLEYER , Raymond Kirk PRICE , Denis Claude Pierre DEMANDOLX , Michael SAMPLES
Abstract: A technique is described herein that employs a resource-efficient image capture system. The image capture system includes an active illumination system for emitting electromagnetic radiation within a physical environment. The image capture system also includes a camera system that includes one or more cameras for detecting electromagnetic radiation received from the physical environment, to produce image information. In one implementation, the technique involves using the same image capture system to produce different kinds of image information for consumption by different respective image processing components. The technique can perform this task by allocating timeslots over a span of time for producing the different kinds of image information. In one case, the image processing components include: a pose tracking component; a controller tracking component; and a surface reconstruction component, etc., any subset of which may be active at any given time.
-
公开(公告)号:US20180373348A1
公开(公告)日:2018-12-27
申请号:US15630113
申请日:2017-06-22
Applicant: Microsoft Technology Licensing, LLC
Inventor: Raymond Kirk PRICE , Michael BLEYER , Denis DEMANDOLX
Abstract: A method of object tracking in a head-mounted display includes illuminating a field of view with an infrared illumination source, capturing an infrared illuminated frame of the field of view with an infrared camera, detecting a tracking object in the field of view, calculating an x-position and a y-position of the tracking object in the field of view, measuring a maximum brightness of the tracking object, and calculating a position of the tracking object using the maximum brightness.
-
23.
公开(公告)号:US20240365018A1
公开(公告)日:2024-10-31
申请号:US18306730
申请日:2023-04-25
Applicant: Microsoft Technology Licensing, LLC
CPC classification number: H04N25/63 , G06T7/11 , G06V10/761
Abstract: A system for modifying a dark current image is configurable to receive an input image depicting a dark current state for one or more pixels of the input image, The dark current state for one or more pixels of the input image comprises one of: a faulty state or a non-faulty state. The system is configurable to partition the input image into a plurality of partitions and generate an updated input image by imposing at least one quantity constraint or at least one severity constraint to the plurality of partitions in association with at least one type of dark current state.
-
公开(公告)号:US20240362749A1
公开(公告)日:2024-10-31
申请号:US18306693
申请日:2023-04-25
Applicant: Microsoft Technology Licensing, LLC
CPC classification number: G06T5/00 , G06T5/50 , G06T2207/20224
Abstract: A system for generating a dark current residual image is configurable to generate a weighted average image by: (i) determining a region-based weight value for each pixel of an input image based upon a light level of a region in which the pixel lies; and (ii) combining the input image with a previous image using the region-based weight values for each pixel of the input image. The system is also configurable to generate a dark current residual image based upon the weighted average image.
-
25.
公开(公告)号:US20240345400A1
公开(公告)日:2024-10-17
申请号:US18640218
申请日:2024-04-19
Applicant: Microsoft Technology Licensing, LLC
Inventor: Raymond Kirk PRICE , Michael BLEYER , Christopher Douglas EDMONDS , William Chao-Hui HWANG
IPC: G02B27/01 , H04N23/65 , H04N25/441 , H04N25/445
CPC classification number: G02B27/0172 , H04N23/651 , H04N25/441 , H04N25/445
Abstract: A system for power efficient image acquisition is configurable to capture, using an image sensor, a plurality of partial image frames including at least a first partial image frame and a second partial image frame. The first partial image frame is captured at a first timepoint using a first subset of image sensing pixels of the plurality of image sensing pixels of the image sensor. The second partial image frame is captured at a second timepoint using a second subset of image sensing pixels of the plurality of image sensing pixels of the image sensor. The second subset of image sensing pixels includes different image sensing pixels than the first subset of image sensing pixels, and the second timepoint is temporally subsequent to the first timepoint. The system is configurable to generate a composite image frame based on the plurality of partial image frames.
-
公开(公告)号:US20240233078A1
公开(公告)日:2024-07-11
申请号:US18615297
申请日:2024-03-25
Applicant: Microsoft Technology Licensing, LLC
Inventor: Raymond Kirk PRICE , Michael BLEYER , Christopher Douglas EDMONDS
IPC: G06T3/4061 , G06T3/4007 , H04N23/10 , H04N23/951
CPC classification number: G06T3/4061 , G06T3/4007 , H04N23/10 , H04N23/951
Abstract: Techniques for generating a high resolution full color output image from lower resolution sparse color input images are disclosed. A camera generates images. The camera's sensor has a sparse Bayer pattern. While the camera is generating the images, IMU data for each image is acquired. The IMU data indicates a corresponding pose the camera was in while the camera generated each image. The images and IMU data are fed into a motion model, which performs temporal filtering on the images and uses the IMU data to generate a red-only image, a green-only image, a blue-only image, and a monochrome image. The color images are up-sampled to match the resolution of the monochrome image. A high resolution output color image is generated by combining the up-sampled images and the monochrome image.
-
公开(公告)号:US20240153131A1
公开(公告)日:2024-05-09
申请号:US18414839
申请日:2024-01-17
Applicant: Microsoft Technology Licensing, LLC
Inventor: Raymond Kirk PRICE , Michael BLEYER , Christopher Douglas EDMONDS
IPC: G06T7/73 , G06T7/593 , G06T7/80 , H04N13/239 , H04N13/296 , H04N13/344
CPC classification number: G06T7/73 , G06T7/593 , G06T7/85 , H04N13/239 , H04N13/296 , H04N13/344 , G06T2207/10028 , G06T2207/30244
Abstract: Techniques for aligning images generated by an integrated camera physically mounted to an HMD with images generated by a detached camera physically unmounted from the HMD are disclosed. A 3D feature map is generated and shared with the detached camera. Both the integrated camera and the detached camera use the 3D feature map to relocalize themselves and to determine their respective 6 DOF poses. The HMD receives the detached camera's image of the environment and the 6 DOF pose of the detached camera. A depth map of the environment is accessed. An overlaid image is generated by reprojecting a perspective of the detached camera's image to align with a perspective of the integrated camera and by overlaying the reprojected detached camera's image onto the integrated camera's image.
-
公开(公告)号:US20240061251A1
公开(公告)日:2024-02-22
申请号:US18384572
申请日:2023-10-27
Applicant: Microsoft Technology Licensing, LLC
CPC classification number: G02B27/0172 , G06T7/337 , G06T7/248 , G06F3/012 , G06F3/017 , G06T19/006 , G02B2027/0138
Abstract: Techniques for updating a position of overlaid image content using IMU data to reflect subsequent changes in camera positions to minimize latency effects are disclosed. A “system camera” refers to an integrated camera that is a part of an HMD. An “external camera” is a camera that is separated from the HMD. The system camera and the external camera generate images. These images are overlaid on one another and aligned to form an overlaid image. Content from the external camera image is surrounded by a bounding element in the overlaid image. IMU data associated with both the system camera and the external camera is obtained. Based on that IMU data, an amount of movement that the system camera and/or the external camera have moved since the images were originally generated is determined. Based on that movement, the bounding element is shifted to a new position in the overlaid image.
-
公开(公告)号:US20230309207A1
公开(公告)日:2023-09-28
申请号:US17656590
申请日:2022-03-25
Applicant: Microsoft Technology Licensing, LLC
Inventor: Raymond Kirk PRICE , Michael BLEYER , Christopher Douglas EDMONDS
IPC: H05B47/105 , F21V21/084
CPC classification number: H05B47/105 , F21V21/084
Abstract: A computing system includes an illumination light source configured to emit illumination light into an external environment and an orientation sensor configured to estimate an orientation of the illumination light source relative to the external environment. The computing system includes a logic subsystem and a storage subsystem holding instructions executable by the logic subsystem to define a light restriction zone within the external environment. Based at least in part on the orientation of the illumination light source, the illumination light source is dynamically controlled to direct the illumination light toward at least a portion of the external environment outside the light restriction zone, while mitigating emission of the illumination light into the light restriction zone.
-
30.
公开(公告)号:US20230292022A1
公开(公告)日:2023-09-14
申请号:US18318533
申请日:2023-05-16
Applicant: Microsoft Technology Licensing, LLC
Inventor: Raymond Kirk PRICE , Michael BLEYER , Christopher Douglas EDMONDS
Abstract: A system for dark current compensation in SPAD imagery is configurable to capture an image frame with the SPAD array and generate a temporally filtered image by performing a temporal filtering operation using the image frame and at least one preceding image frame. The at least one preceding image frame is captured by the SPAD array at a timepoint that temporally precedes a timepoint associated with the image frame. The system is also configurable to obtain a dark current image frame. The dark current image frame includes data indicating one or more SPAD pixels of the plurality of SPAD pixels that detect an avalanche event without detecting a corresponding photon. The system is also configurable to generate a dark current compensated image by performing a subtraction operation on the temporally filtered image or the image frame based on the dark current image frame.
-
-
-
-
-
-
-
-
-