-
公开(公告)号:US20230194875A1
公开(公告)日:2023-06-22
申请号:US18108161
申请日:2023-02-10
Applicant: Microsoft Technology Licensing, LLC
Inventor: Raymond Kirk PRICE , Christopher Douglas EDMONDS , Michael BLEYER
IPC: G02B27/01 , H05B47/11 , H05B47/19 , G01S17/894 , G01B11/02
CPC classification number: G02B27/0172 , G01B11/026 , G01S17/894 , H05B47/11 , H05B47/19 , G02B2027/0118 , G02B2027/0138
Abstract: Disclosed herein are techniques for providing an illumination system that emits illumination into an environment while also enabling that system to be undetectable to certain types of external light detection systems. The system includes a single photon avalanche diode (SPAD) low light (LL) detection device and a light emitting device. The light emitting device provides illumination having a wavelength of at least 950 nanometers (nm). An intensity of the illumination is set to a level that causes the illumination to be undetectable from a determined distance away based on the roll off rate of the light. While the light emitting device is providing the illumination, the SPAD LL detection device generates an image of an environment in which the illumination is being provided.
-
12.
公开(公告)号:US20230123494A1
公开(公告)日:2023-04-20
申请号:US17505507
申请日:2021-10-19
Applicant: Microsoft Technology Licensing, LLC
Inventor: Raymond Kirk PRICE , Michael BLEYER , Christopher Douglas EDMONDS
Abstract: A system for selectively modifying gating rate in a single photon avalanche diode (SPAD) is configurable to access first frame metadata associated with a first image frame. The first image frame is captured by performing a first plurality of gate operations to configure the SPAD array to enable photon detection over a frame capture time period. The first plurality of gate operations is performed at a first gating rate such that the first plurality of gate operations comprises a first quantity of gate operations performed over the frame capture time period. The system is further configurable to define a second gating rate based on the first frame metadata and capture a second image frame by performing a second plurality of gate operations to configure the SPAD array to enable photon detection at the second gating rate.
-
公开(公告)号:US20230076331A1
公开(公告)日:2023-03-09
申请号:US17986445
申请日:2022-11-14
Applicant: Microsoft Technology Licensing, LLC
Abstract: Techniques for updating a position of overlaid image content using IMU data to reflect subsequent changes in camera positions to minimize latency effects are disclosed. A “system camera” refers to an integrated camera that is a part of an HMD. An “external camera” is a camera that is separated from the HMD. The system camera and the external camera generate images. These images are overlaid on one another and aligned to form an overlaid image. Content from the external camera image is surrounded by a bounding element in the overlaid image. IMU data associated with both the system camera and the external camera is obtained. Based on that IMU data, an amount of movement that the system camera and/or the external camera have moved since the images were originally generated is determined. Based on that movement, the bounding element is shifted to a new position in the overlaid image.
-
14.
公开(公告)号:US20220335637A1
公开(公告)日:2022-10-20
申请号:US17235159
申请日:2021-04-20
Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
Inventor: Raymond Kirk PRICE , Michael BLEYER , Christopher Douglas EDMONDS
Abstract: A system for low compute high-resolution depth map generation using low-resolution cameras is configured to obtain a stereo pair of images and generate a depth map by performing stereo matching on the stereo pair of images. The system is also configured to obtain a first image comprising first texture information for the environment that has a first image resolution that is higher than an image resolution of images of the stereo pair of images. The system is further configured to generate a reprojected first image by reprojecting the first image to correspond to an image capture perspective associated with the depth map. The reprojection of the first image is based on depth information from the depth map and includes reprojected first texture information for the environment. The system is also configured to generate an upsampled depth map based on the depth map.
-
公开(公告)号:US20220222906A1
公开(公告)日:2022-07-14
申请号:US17147378
申请日:2021-01-12
Applicant: Microsoft Technology Licensing, LLC
Inventor: Raymond Kirk PRICE , Michael BLEYER , Christopher Douglas EDMONDS
IPC: G06T19/20 , G01P3/38 , G01D5/39 , G06T7/70 , G01S17/894
Abstract: Examples are disclosed that relate to motion compensation on a single photon avalanche detector (SPAD) array camera. One example provides a method enacted on an imaging device comprising a SPAD array camera and a motion sensor, the SPAD array camera comprising a plurality of pixels. The method comprises acquiring a plurality of subframes of image data. Each subframe of image data comprises a binary value for each pixel. Based upon motion data from the motion sensor, the method further comprises determining a change in pose of the imaging device between adjacent subframes, applying a positional offset to a current subframe based upon the motion data to align a location of a stationary imaged feature in the current subframe with a location of the stationary imaged feature in a prior subframe to create aligned subframes, summing the aligned subframes to form an image, and outputting the image.
-
公开(公告)号:US20220174188A1
公开(公告)日:2022-06-02
申请号:US17107310
申请日:2020-11-30
Applicant: Microsoft Technology Licensing, LLC
Inventor: Raymond Kirk PRICE , Michael BLEYER , Christopher Douglas EDMONDS
IPC: H04N5/217 , G06T7/593 , H04N13/239 , G06T7/20 , H04N13/254 , G02B27/01
Abstract: An HMD includes a single photon avalanche diode (SPAD) array comprising a plurality of SPAD pixels. The HMD also includes a display positioned to display images for viewing by an eye of a user. The HMD also includes one or more processors and one or more hardware storage devices storing instructions that are executable by the one or more processors to configure the HMD to perform various acts associated with using the SPAD array to capture an image frame of an environment for display to the user.
-
公开(公告)号:US20220028095A1
公开(公告)日:2022-01-27
申请号:US16936377
申请日:2020-07-22
Applicant: Microsoft Technology Licensing, LLC
Inventor: Michael BLEYER , Christopher Douglas EDMONDS , Michael Edward SAMPLES , Sudipta Narayan SINHA , Matthew Beaudoin KARR , Raymond Kirk PRICE
Abstract: A system for continuous image alignment of separate cameras identifies a reference camera transformation matrix between a base reference camera pose and an updated reference camera pose. The system also identifies a match camera transformation matrix between a base match camera pose and an updated match camera pose and an alignment matrix based on visual correspondences between one or more reference frames captured by the reference camera and one or more match frames captured by the match camera. The system also generates a motion model configured to facilitate mapping of a set of pixels of a reference frame captured by the reference camera to a corresponding set of pixels of a match frame captured by the match camera based on the reference camera transformation matrix, the match camera transformation matrix, and the alignment matrix.
-
公开(公告)号:US20210392316A1
公开(公告)日:2021-12-16
申请号:US17319553
申请日:2021-05-13
Applicant: Microsoft Technology Licensing, LLC
Inventor: Michael BLEYER , Christopher Douglas EDMONDS , Raymond Kirk PRICE
IPC: H04N13/239 , H04N13/296 , H04N5/365 , H04N5/369 , H04N5/378
Abstract: Systems having rolling shutter sensors with a plurality of sensor rows are configured for compensating for rolling shutter artifacts that result from different sensor rows in the plurality of sensor rows outputting sensor data at different times. The systems compensate for the rolling shutter artifacts by identifying readout timepoints for the plurality of sensor rows of the rolling shutter sensor while the rolling shutter sensor captures an image of an environment and identifying readout poses each readout timepoint, as well as obtaining a depth map based on the image. The depth map includes a plurality of different rows of depth data that correspond to the different sensor rows. The system further compensates for the rolling shutter artifacts by generating a 3D representation of the environment while unprojecting the rows of depth data into 3D space using the readout poses.
-
公开(公告)号:US20210208390A1
公开(公告)日:2021-07-08
申请号:US16736573
申请日:2020-01-07
Applicant: Microsoft Technology Licensing, LLC
Abstract: A head-mounted display is presented. The head-mounted display includes an inertial measurement unit (IMU), one or more displays and a controller. The controller is configured to establish a reprojection plane for displaying imagery on the one or more displays. Based on output from the IMU, the position and orientation of the HMD relative to the reprojection plane is determined. Image data is then reprojected to the displays. A depth treatment is applied to each of a plurality of locations on the displays based on the determined position and orientation of the HMD relative to the reprojection plane.
-
20.
公开(公告)号:US20240031624A1
公开(公告)日:2024-01-25
申请号:US18482654
申请日:2023-10-06
Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
Inventor: Raymond Kirk PRICE , Michael BLEYER , Christopher Douglas EDMONDS
IPC: H04N21/2343 , G06T3/40 , H04N21/242 , H04N23/90 , H04N23/68
CPC classification number: H04N21/234363 , G06T3/4053 , H04N21/234381 , H04N21/242 , H04N23/90 , H04N23/689
Abstract: A system for generating high-resolution video from low-resolution images is configured to access a first video stream and a second video stream capturing an environment. The first video stream is captured by a first video capture device. The second video stream is captured by a second video capture device. Image frames of the first video stream are temporally synchronized with corresponding image frames of the second video stream. The system is also configured to generate a composite video stream with a higher resolution than the first or second video streams. Each composite image frame of the composite video stream is generated using a respective image frame of the first video stream and a temporally synchronized corresponding image frame of the second video stream as input.
-
-
-
-
-
-
-
-
-