公开(公告)号：US11721032B2

公开(公告)日：2023-08-08

申请号：US17354849

申请日：2021-06-22

Applicant: Microsoft Technology Licensing, LLC

Inventor： Michael Bleyer ,  Christopher D. Edmonds ,  Yuri Pekelny

IPC: G06T7/521 ,  G06T5/40 ,  G06T7/00

CPC classification number: G06T7/521 ,  G06T5/40 ,  G06T7/0002 ,  G06T2207/10028 ,  G06T2207/30168

Abstract: The described implementations relate to reducing distance errors in depth maps. One example can detect blooming in a depth map. This example can identify a depth range affected by the blooming and take an action relating to the identified depth range to address the blooming.

公开(公告)号：US11683593B2

公开(公告)日：2023-06-20

申请号：US17852131

申请日：2022-06-28

Applicant: Microsoft Technology Licensing, LLC

Inventor： Raymond Kirk Price ,  Christopher Douglas Edmonds ,  Michael Bleyer

IPC: H04N23/741 ,  H04N23/73 ,  G06T5/00 ,  G06T5/50

CPC classification number: H04N23/741 ,  G06T5/003 ,  G06T5/50 ,  H04N23/73 ,  G06T2207/10144 ,  G06T2207/20201 ,  G06T2207/20208

Abstract: A system for HDR image capture is configurable to perform a split long exposure operation by applying a first set of long exposure shutter operations to configure each sensor pixel of the image sensor array to enable photon detection and applying a second set of long exposure shutter operations to configure each sensor pixel to enable photon detection. A time period intervenes between the first and second sets of long exposure shutter. The system is configurable to perform a short exposure operation by applying a set of short exposure shutter operations to configure each sensor pixel to enable photon detection. The short exposure operation occurs during the time period that intervenes between the first and second sets of long exposure shutter operations. The system is also configurable to generate an image based on the split long exposure operation and the short exposure operation.

公开(公告)号：US11676250B1

公开(公告)日：2023-06-13

申请号：US17567570

申请日：2022-01-03

Applicant: Microsoft Technology Licensing, LLC

Inventor： Raymond Kirk Price ,  Michael Bleyer ,  Christopher Douglas Edmonds

IPC: G06T5/00 ,  H04N5/265 ,  G06T3/40 ,  G06T5/50 ,  H04N23/84 ,  H04N23/951

CPC classification number: G06T5/003 ,  G06T3/4053 ,  G06T5/50 ,  H04N5/265 ,  H04N23/843 ,  H04N23/951 ,  G06T2207/10024 ,  G06T2207/20201

Abstract: Techniques for using motion data to generate a high resolution output color image from multiple images having sparse color information are disclosed. A camera generates multiple images. The camera's sensor is configured to have a sparse Bayer pattern. While the camera is generating the images, IMU data for each image is acquired. The IMU data indicates a corresponding pose the camera was in while the camera generated each image. The images and the IMU data are fed as input into a motion model. The motion model performs temporal filtering on the images and uses the IMU data to generate a red-only image, a green-only image, and a blue-only image. A high resolution output color image is generated by combining the red-only image, the green-only image, and the blue-only image.

公开(公告)号：US11642589B2

公开(公告)日：2023-05-09

申请号：US16937457

申请日：2020-07-23

Applicant: Microsoft Technology Licensing, LLC

Inventor： Raymond Kirk Price ,  Michael Bleyer ,  Christopher Douglas Edmonds ,  Mark Anthony Plagge ,  Melissa Arde Lobb ,  Mikael Froejk Figueroa ,  Jonathan Gustav Paulovich ,  Evan Gregory Levine

IPC: A63F13/211 ,  A63F13/216 ,  A63F13/213 ,  A63F13/245 ,  A63F13/837 ,  G01S19/03 ,  G06F3/01

CPC classification number: A63F13/216 ,  A63F13/211 ,  A63F13/213 ,  A63F13/245 ,  A63F13/837 ,  G01S19/03 ,  G06F3/011 ,  A63F2300/105 ,  A63F2300/1043 ,  A63F2300/1062 ,  A63F2300/1087 ,  A63F2300/8076

Abstract: One method comprises receiving a hit signal from a device worn by a first player, receiving a position of the device, receiving an orientation of a launch axis of a virtual-projectile launcher, receiving a position of a second player, and outputting a hit assignment on determining, pursuant to receiving the hit signal, that a recognized object and the second player are coincident at an indicated launch of a virtual projectile. Another method comprises receiving an indication of launch of a virtual projectile by a virtual-projectile launcher of a first player, receiving an image aligned to a launch axis of the virtual-projectile launcher, outputting a hit signal to a server on determining, pursuant to receiving the indication of launch, that a recognized object is imaged in a projectile-delivery area of the image, and outputting a position of the device and an orientation of the launch axis to the server.

公开(公告)号：US11636645B1

公开(公告)日：2023-04-25

申请号：US17524270

申请日：2021-11-11

Applicant: Microsoft Technology Licensing, LLC

Inventor： Raymond Kirk Price ,  Michael Bleyer ,  Christopher Douglas Edmonds ,  Sudipta Narayan Sinha

IPC: G06T15/20 ,  G06T7/00 ,  G06T7/33

Abstract: Techniques for aligning images generated by two cameras are disclosed. This alignment is performed by computing a relative 3D orientation between the two cameras. A first gravity vector for a first camera and a second gravity vector for a second camera are determined. A first camera image is obtained from the first camera, and a second camera image is obtained from the second camera. A first alignment process is performed to partially align the first camera's orientation with the second camera's orientation. This process is performed by aligning the gravity vectors, thereby resulting in two degrees of freedom of the relative 3D orientation being eliminated. Visual correspondences between the two images are identified. A second alignment process is performed to fully align the orientations. This process is performed by using the identified visual correspondences to identify and eliminate a third degree of freedom of the relative 3D orientation.

公开(公告)号：US11592674B2

公开(公告)日：2023-02-28

申请号：US17306517

申请日：2021-05-03

Applicant: Microsoft Technology Licensing, LLC

Inventor： Raymond Kirk Price ,  Christopher Douglas Edmonds ,  Michael Bleyer

IPC: G02B27/01 ,  G01B11/02 ,  G01S17/894 ,  H05B47/11 ,  H05B47/19

Abstract: Disclosed herein are techniques for providing an illumination system that emits illumination into an environment while also enabling that system to be undetectable to certain types of external light detection systems. The system includes a single photon avalanche diode (SPAD) low light (LL) detection device and a light emitting device. The light emitting device provides illumination having a wavelength of at least 950 nanometers (nm). An intensity of the illumination is set to a level that causes the illumination to be undetectable from a determined distance away based on the roll off rate of the light. While the light emitting device is providing the illumination, the SPAD LL detection device generates an image of an environment in which the illumination is being provided.

公开(公告)号：US11568555B2

公开(公告)日：2023-01-31

申请号：US16907960

申请日：2020-06-22

Applicant: Microsoft Technology Licensing, LLC

Inventor： Michael Bleyer ,  Raymond Kirk Price ,  Christopher Douglas Edmonds

IPC: G06T7/593 ,  G06T7/292 ,  G06T7/246 ,  G02B27/01 ,  G06T19/00

Abstract: A system for dense depth computation aided by sparse feature matching generates a first image using a first camera, a second image using a second camera, and a third image using a third camera. The system generates a sparse disparity map using the first image and the third image by (1) identifying a set of feature points within the first image and a set of corresponding feature points within the third image, and (2) identifying feature disparity values based on the set of feature points and the set of corresponding feature points. The system also applies the first image, the second image, and the sparse disparity map as inputs for generating a dense disparity map.

公开(公告)号：US11563908B2

公开(公告)日：2023-01-24

申请号：US17181962

申请日：2021-02-22

Applicant: Microsoft Technology Licensing, LLC

Inventor： Raymond Kirk Price ,  Michael Bleyer ,  Christopher Douglas Edmonds

IPC: G06T5/00 ,  H04N5/357 ,  H04N5/353 ,  H04N5/378

Abstract: A system for image acquisition with reduced noise using SPADs is configured to perform a plurality of sequential exposure and readout operations. Each exposure and readout operation includes (i) applying a set of shutter operations to configure each SPAD pixel of the SPAD array to enable photon detection, and (ii) for each SPAD pixel of the SPAD array, reading out a number of photons detected during the set of shutter operations. The system is also configured to generate an image based on the number of photons detected for each SPAD pixel during each of the plurality of sequential exposure and readout operations.

公开(公告)号：US11430086B2

公开(公告)日：2022-08-30

申请号：US15931535

申请日：2020-05-13

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Michael Bleyer ,  Raymond Kirk Price ,  Christopher Douglas Edmonds

IPC: G06T3/40 ,  G06T7/593 ,  G06T5/00 ,  G06T5/20 ,  G06T5/50

Abstract: Systems and methods are provided for upsampling low temporal resolution depth maps. This upsampling is performed by obtaining a stereo pair of images of a scene captured at a first timepoint, generating a first depth map of the scene for the first timepoint by performing stereo matching on the stereo pair of images, obtaining a subsequent stereo pair of images captured at a subsequent timepoint to the first timepoint, and generating a subsequent depth map that corresponds to the subsequent timepoint by applying an edge-preserving filter using the first depth map without performing stereo matching on the subsequent stereo pair of images.

公开(公告)号：US11257237B2

公开(公告)日：2022-02-22

申请号：US16555660

申请日：2019-08-29

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Michael Bleyer ,  Yuri Pekelny ,  Raymond Kirk Price

IPC: G06T7/593 ,  G06K9/46 ,  H04N5/235

Abstract: Disclosed herein are optimized techniques for controlling the exposure time or illumination intensity of a depth sensor. Invalid-depth pixels are identified within a first depth map of an environment. For each invalid-depth pixel, a corresponding image pixel is identified in a depth image that was used to generate the first depth map. Multiple brightness intensities are identified from the depth image. Each brightness intensity is categorized as corresponding to either an overexposed or underexposed image pixel. An increased exposure time or illumination intensity or, alternatively, a decreased exposure time or illumination intensity is then used to capture another depth image of the environment. After a second depth map is generated based on the new depth image, portion(s) of the second depth map are selectively merged with the first depth map by replacing the invalid-depth pixels of the first depth map with corresponding valid-depth pixels of the second depth map.