公开(公告)号：US20230245332A1

公开(公告)日：2023-08-03

申请号：US18296559

申请日：2023-04-06

Applicant: Microsoft Technology Licensing, LLC

Inventor： Michael BLEYER ,  Christopher Douglas EDMONDS ,  Dominik Alexander KONIK ,  Raymond Kirk PRICE

IPC: G06T7/33 ,  G06T7/80 ,  G02B27/01

CPC classification number: G06T7/337 ,  G06T7/80 ,  G02B27/0189 ,  G02B2027/0198

Abstract: A system for updating continuous image alignment of separate cameras identifies a previous alignment matrix associated with a previous frame pair captured at one or more previous timepoints by a reference camera and a match camera. The previous alignment matrix is based on visual correspondences in the previous frame pair. The system also identifies a current matrix associated with a current frame pair captured at one or more current timepoints by the reference camera and the match camera. The current matrix is based on visual correspondences in the current frame pair. The system also identifies a difference value associated with the reference camera or the match camera relative to the one or more previous timepoints and the one or more current timepoints. The system also generates an updated alignment matrix by using the previous alignment matrix, the current matrix, and the difference value as inputs.

公开(公告)号：US20230117006A1

公开(公告)日：2023-04-20

申请号：US17506218

申请日：2021-10-20

Applicant: Microsoft Technology Licensing, LLC

Inventor： Raymond Kirk PRICE ,  Michael BLEYER ,  Christopher Douglas EDMONDS ,  Casey Lee MILLER

IPC: H04N5/361 ,  G06T5/00 ,  H04N5/347 ,  G06T5/20 ,  G06T5/50 ,  H04N5/365 ,  G06T3/40

Abstract: A system for obtaining dark current images includes one or more processors and one or more hardware storage devices storing instructions that are executable by the one or more processors to configure the system to perform various acts. The acts include obtaining a first image frame, generating a first low-pass filtered image by applying a low-pass filter to the first image frame, and generating a first estimated dark current image by subtracting the first low-pass filtered image from the first image frame.

公开(公告)号：US20230022734A1

公开(公告)日：2023-01-26

申请号：US17956626

申请日：2022-09-29

Applicant: Microsoft Technology Licensing, LLC

Inventor： Raymond Kirk PRICE ,  Michael BLEYER ,  Christopher Douglas EDMONDS

IPC: G06T7/593 ,  G06T7/73 ,  H04N13/128 ,  H04N13/271

Abstract: Systems and methods are provided performing for low compute depth map generation by implementing acts of obtaining a stereo pair of images of a scene, downsampling the stereo pair of images, generating a depth map by stereo matching the downsampled stereo pair of images, and generating an upsampled depth map based on the depth map using an edge-preserving filter for obtaining at least some data of at least one image of the stereo pair of images.

公开(公告)号：US20230005179A1

公开(公告)日：2023-01-05

申请号：US17941859

申请日：2022-09-09

Applicant: Microsoft Technology Licensing, LLC

Inventor： Raymond Kirk PRICE ,  Michael BLEYER ,  Christopher Douglas EDMONDS

IPC: G06T7/73 ,  G06T7/593 ,  G06T7/80 ,  H04N13/296 ,  H04N13/344 ,  H04N13/239

Abstract: Techniques for aligning images generated by an integrated camera physically mounted to an HMD with images generated by a detached camera physically unmounted from the HMD are disclosed. A 3D feature map is generated and shared with the detached camera. Both the integrated camera and the detached camera use the 3D feature map to relocalize themselves and to determine their respective 6 DOF poses. The HMD receives the detached camera's image of the environment and the 6 DOF pose of the detached camera. A depth map of the environment is accessed. An overlaid image is generated by reprojecting a perspective of the detached camera's image to align with a perspective of the integrated camera and by overlaying the reprojected detached camera's image onto the integrated camera's image.

公开(公告)号：US20220385842A1

公开(公告)日：2022-12-01

申请号：US17334618

申请日：2021-05-28

Applicant: Microsoft Technology Licensing, LLC

Inventor： Raymond Kirk PRICE ,  Michael BLEYER ,  Christopher Douglas EDMONDS

IPC: H04N5/361 ,  G06T3/40 ,  H04N5/347

Abstract: A system for dark current compensation in SPAD imagery is configurable to capture an image frame with the SPAD array and generate a temporally filtered image by performing a temporal filtering operation using the image frame and at least one preceding image frame. The at least one preceding image frame is captured by the SPAD array at a timepoint that temporally precedes a timepoint associated with the image frame. The system is also configurable to obtain a dark current image frame. The dark current image frame includes data indicating one or more SPAD pixels of the plurality of SPAD pixels that detect an avalanche event without detecting a corresponding photon. The system is also configurable to generate a dark current compensated image by performing a subtraction operation on the temporally filtered image or the image frame based on the dark current image frame.

公开(公告)号：US20220382056A1

公开(公告)日：2022-12-01

申请号：US17334603

申请日：2021-05-28

Applicant: Microsoft Technology Licensing, LLC

Inventor： Raymond Kirk PRICE ,  Michael BLEYER ,  Christopher Douglas EDMONDS ,  William Chao-Hui HWANG

IPC: G02B27/01 ,  H01L31/02 ,  H01L31/107

Abstract: A system for power efficient image acquisition is configurable to capture, using an image sensor, a plurality of partial image frames including at least a first partial image frame and a second partial image frame. The first partial image frame is captured at a first timepoint using a first subset of image sensing pixels of the plurality of image sensing pixels of the image sensor. The second partial image frame is captured at a second timepoint using a second subset of image sensing pixels of the plurality of image sensing pixels of the image sensor. The second subset of image sensing pixels includes different image sensing pixels than the first subset of image sensing pixels, and the second timepoint is temporally subsequent to the first timepoint. The system is configurable to generate a composite image frame based on the plurality of partial image frames.

公开(公告)号：US20220351650A1

公开(公告)日：2022-11-03

申请号：US17246516

申请日：2021-04-30

Applicant: Microsoft Technology Licensing, LLC

Inventor： Raymond Kirk PRICE ,  Michael BLEYER ,  Christopher Douglas EDMONDS

IPC: G09F9/33 ,  G06T7/70 ,  G06T7/207 ,  G06K9/32 ,  G06K9/62 ,  H01L31/107

Abstract: A system for adding persistence to SPAD imagery is configurable to capture, using a SPAD array, a plurality of image frames. The system is configurable to capture, using an IMU, pose data associated with the plurality of image frames. The pose data includes at least respective pose data associated with each of the plurality of image frames. The system is configurable to determine a persistence term based on the pose data. The system is also configurable to generate a composite image based on the plurality of image frames, the respective pose data associated with each of the plurality of image frames, and the persistence term. The persistence term defines a contribution of each of the plurality of image frames to the composite image.

公开(公告)号：US20220342212A1

公开(公告)日：2022-10-27

申请号：US17241725

申请日：2021-04-27

Applicant: Microsoft Technology Licensing, LLC

Inventor： Raymond Kirk PRICE ,  Michael BLEYER ,  Christopher Douglas EDMONDS

IPC: G02B27/00 ,  G02B27/01

Abstract: In one method, device data including an orientation of a targeting device is received in a computing system. Target coordinates of the targeting device as projected onto a field-of-view of a display device are then located based on the device data. Pursuant to locating the target coordinates within a predefined margin, a target graphic indicating the target coordinates is superposed onto the field-of-view. Pursuant to locating the target coordinates outside of the predefined margin, an off-target graphic is superposed onto the field-of-view and aligned to a display perimeter of the display device.

公开(公告)号：US20220335578A1

公开(公告)日：2022-10-20

申请号：US17230518

申请日：2021-04-14

Applicant: Microsoft Technology Licensing, LLC

Inventor： Raymond Kirk PRICE ,  Michael BLEYER ,  Christopher Douglas EDMONDS

IPC: G06T5/00 ,  G06T5/20 ,  G06T5/50 ,  G06T7/40 ,  G06T7/13 ,  G06T7/174 ,  G06T3/40 ,  G02B27/01

Abstract: Techniques for generating an enhanced image. A first image is generated using a camera of a first modality, and a second image is generated using a camera of a second modality. Pixels that are common between the two images are identified. An alpha map is generated. The alpha map reflects edge detection weights that are computed for the common pixels based on saliency values. A determination is made as to how much texture from the images to use to generate an enhanced image. This determination is based on the edge detection weights included within the alpha map. Based on the edge detection weights, textures are merged from the common pixels to generate the enhanced image. Color is also added to the enhanced image, where the color reflects an additional property (e.g., the texture source for the pixel) that is associated with one or both of the images.

公开(公告)号：US20220028169A1

公开(公告)日：2022-01-27

申请号：US16934572

申请日：2020-07-21

Applicant: Microsoft Technology Licensing, LLC

Inventor： Raymond Kirk PRICE ,  Michael BLEYER ,  Christopher Douglas EDMONDS

IPC: G06T19/00 ,  G02B27/01 ,  H04N5/33 ,  H04N13/344

Abstract: A head-mounted device (HMD) is structured to include at least one computer vision camera that omits an IR light filter. Consequently, this computer vision's sensor is able to detect IR light, including IR laser light, in the environment. The HMD is configured to generate an image of the environment using the computer vision camera. This image is then fed as input into a machine learning (ML) algorithm that identifies IR laser light, which is detected by the sensor and which is recorded in the image. The HMD then visually displays a notification comprising information corresponding to the detected IR laser light.