公开(公告)号：US12277681B2

公开(公告)日：2025-04-15

申请号：US18211376

申请日：2023-06-19

Applicant: Microsoft Technology Licensing, LLC

Inventor： Raymond Kirk Price ,  Christopher Douglas Edmonds ,  Michael Bleyer ,  Christian Markus Maekelae

IPC: G06T5/50 ,  G06T3/40 ,  G06T5/70 ,  H04N23/68

Abstract: Techniques to temporally filter images via a filtering weight computation are disclosed. A first image having a first timestamp and a second image having a second timestamp are acquired. These images are generated by a camera, and the first timestamp is before the second timestamp. A motion compensation (MC) operation is performed on the first image to produce an MC image. A difference image is generated using the MC image and the second image. The difference image reflects differences in intensities that exist between the two images. A local weight map is generated based on those differences. A global weight map is generated based on certain IMU data. A final weight map is generated based on a combination of the local weight map and the global weight map. The final weight map is used to generate a filtered image.

公开(公告)号：US12095978B2

公开(公告)日：2024-09-17

申请号：US17655964

申请日：2022-03-22

Applicant: Microsoft Technology Licensing, LLC

Inventor： Raymond Kirk Price ,  Michael Bleyer ,  Christopher Douglas Edmonds

IPC: H04N13/398 ,  G01B11/22 ,  G01S17/89 ,  H04N13/00 ,  H04N13/239 ,  H04N13/383

CPC classification number: H04N13/398 ,  G01B11/22 ,  G01S17/89 ,  H04N13/239 ,  H04N13/383 ,  H04N2013/0081

Abstract: Examples are disclosed that relate to providing image data to a user in a defined space of a surrounding environment from a perspective of the user. One example provides a computing system, comprising a logic subsystem, and a storage subsystem comprising instructions executable by the logic subsystem to obtain information regarding a pose of a user within a defined space, based upon the pose of the user, determine a portion of an environment surrounding the defined space toward which the user is looking, obtain image data representing the portion of the environment from a perspective of the user, and provide the image data for display via a display device within the defined space.

公开(公告)号：US12073540B2

公开(公告)日：2024-08-27

申请号：US18142418

申请日：2023-05-02

Applicant: Microsoft Technology Licensing, LLC

Inventor： Raymond Kirk Price ,  Michael Bleyer ,  Christopher Douglas Edmonds

IPC: G06T5/73 ,  G06T3/4053 ,  G06T5/50 ,  H04N5/265 ,  H04N23/84 ,  H04N23/951

CPC classification number: G06T5/73 ,  G06T3/4053 ,  G06T5/50 ,  H04N5/265 ,  H04N23/843 ,  H04N23/951 ,  G06T2207/10024 ,  G06T2207/20201

Abstract: Techniques for using motion data to generate a high resolution output color image from multiple images having sparse color information are disclosed. A camera generates multiple images. The camera's sensor is configured to have a sparse Bayer pattern. While the camera is generating the images, IMU data for each image is acquired. The IMU data indicates a corresponding pose the camera was in while the camera generated each image. The images and the IMU data are fed as input into a motion model. The motion model performs temporal filtering on the images and uses the IMU data to generate a red-only image, a green-only image, and a blue-only image. A high resolution output color image is generated by combining the red-only image, the green-only image, and the blue-only image.

公开(公告)号：US11972549B2

公开(公告)日：2024-04-30

申请号：US17500145

申请日：2021-10-13

Applicant: Microsoft Technology Licensing, LLC

Inventor： Michael Bleyer ,  Raymond Kirk Price ,  Christopher Douglas Edmonds

IPC: G06K9/00 ,  G02B27/01 ,  G06T7/00 ,  G06T19/00

CPC classification number: G06T7/0002 ,  G02B27/0172 ,  G06T7/97 ,  G06T19/006 ,  G02B2027/0138 ,  G02B2027/014 ,  G06T2207/30168

Abstract: Techniques for evaluating multiple images, which originate from multiple different sources, and for selecting specific images to generate an overlaid image are disclosed. A first set of system camera images (e.g., based on a first FPS rate) and a second set of external camera images (e.g., based on a second FPS rate) are obtained. A set of rules are accessed in order to govern a selection process for selecting a specific system camera image and a specific external camera image. The selected images are designated for use in generating an overlaid image. The selection process is performed using the accessed set of rules. The overlaid image is generated by overlaying and aligning content obtained from the selected images.

公开(公告)号：US11941751B2

公开(公告)日：2024-03-26

申请号：US18128322

申请日：2023-03-30

Applicant: Microsoft Technology Licensing, LLC

Inventor： Raymond Kirk Price ,  Michael Bleyer ,  Christopher Douglas Edmonds ,  Sudipta Narayan Sinha

IPC: G06T15/20 ,  G06T7/00 ,  G06T7/33

CPC classification number: G06T15/205 ,  G06T7/33 ,  G06T7/97

Abstract: Techniques for aligning images generated by two cameras are disclosed. This alignment is performed by computing a relative 3D orientation between the two cameras. A first gravity vector for a first camera and a second gravity vector for a second camera are determined. A first camera image is obtained from the first camera, and a second camera image is obtained from the second camera. A first alignment process is performed to partially align the first camera's orientation with the second camera's orientation. This process is performed by aligning the gravity vectors, thereby resulting in two degrees of freedom of the relative 3D orientation being eliminated. Visual correspondences between the two images are identified. A second alignment process is performed to fully align the orientations. This process is performed by using the identified visual correspondences to identify and eliminate a third degree of freedom of the relative 3D orientation.

公开(公告)号：US11922655B2

公开(公告)日：2024-03-05

申请号：US17941859

申请日：2022-09-09

Applicant: Microsoft Technology Licensing, LLC

Inventor： Raymond Kirk Price ,  Michael Bleyer ,  Christopher Douglas Edmonds

IPC: G06T7/70 ,  G06T7/593 ,  G06T7/73 ,  G06T7/80 ,  H04N13/239 ,  H04N13/296 ,  H04N13/344

CPC classification number: G06T7/73 ,  G06T7/593 ,  G06T7/85 ,  H04N13/239 ,  H04N13/296 ,  H04N13/344 ,  G06T2207/10028 ,  G06T2207/30244

Abstract: Techniques for aligning images generated by an integrated camera physically mounted to an HMD with images generated by a detached camera physically unmounted from the HMD are disclosed. A 3D feature map is generated and shared with the detached camera. Both the integrated camera and the detached camera use the 3D feature map to relocalize themselves and to determine their respective 6 DOF poses. The HMD receives the detached camera's image of the environment and the 6 DOF pose of the detached camera. A depth map of the environment is accessed. An overlaid image is generated by reprojecting a perspective of the detached camera's image to align with a perspective of the integrated camera and by overlaying the reprojected detached camera's image onto the integrated camera's image.

公开(公告)号：US11892624B2

公开(公告)日：2024-02-06

申请号：US17241725

申请日：2021-04-27

Applicant: Microsoft Technology Licensing, LLC

Inventor： Raymond Kirk Price ,  Michael Bleyer ,  Christopher Douglas Edmonds

IPC: G02B27/00 ,  G02B27/01 ,  A63F13/211 ,  A63F13/25 ,  A63F13/426 ,  A63F13/573 ,  A63F13/537 ,  A63F13/837

CPC classification number: G02B27/0093 ,  A63F13/211 ,  A63F13/25 ,  A63F13/426 ,  A63F13/537 ,  A63F13/573 ,  G02B27/017 ,  G02B27/0189 ,  A63F13/837 ,  A63F2300/8082 ,  G02B2027/014 ,  G02B2027/019 ,  G02B2027/0138

Abstract: In one method, device data including an orientation of a targeting device is received in a computing system. Target coordinates of the targeting device as projected onto a field-of-view of a display device are then located based on the device data. Pursuant to locating the target coordinates within a predefined margin, a target graphic indicating the target coordinates is superposed onto the field-of-view. Pursuant to locating the target coordinates outside of the predefined margin, an off-target graphic is superposed onto the field-of-view and aligned to a display perimeter of the display device.

公开(公告)号：US11881129B2

公开(公告)日：2024-01-23

申请号：US17246516

申请日：2021-04-30

Applicant: Microsoft Technology Licensing, LLC

Inventor： Raymond Kirk Price ,  Michael Bleyer ,  Christopher Douglas Edmonds

IPC: G08B5/22 ,  G09F9/33 ,  G06T7/207 ,  G06T7/70 ,  G06V10/25 ,  G06V10/75 ,  H01L31/107

CPC classification number: G09F9/33 ,  G06T7/207 ,  G06T7/70 ,  G06V10/25 ,  G06V10/7557 ,  H01L31/107 ,  G09G2320/06

Abstract: A system for adding persistence to SPAD imagery is configurable to capture, using a SPAD array, a plurality of image frames. The system is configurable to capture, using an IMU, pose data associated with the plurality of image frames. The pose data includes at least respective pose data associated with each of the plurality of image frames. The system is configurable to determine a persistence term based on the pose data. The system is also configurable to generate a composite image based on the plurality of image frames, the respective pose data associated with each of the plurality of image frames, and the persistence term. The persistence term defines a contribution of each of the plurality of image frames to the composite image.

公开(公告)号：US11776138B2

公开(公告)日：2023-10-03

申请号：US17122661

申请日：2020-12-15

Applicant: Microsoft Technology Licensing, LLC

Inventor： Michael Bleyer ,  Christopher Douglas Edmonds ,  Raymond Kirk Price

IPC: G06T7/11 ,  G06T7/136 ,  G06T7/269

CPC classification number: G06T7/269 ,  G06T7/11 ,  G06T7/136 ,  G06T2207/20192 ,  G06T2207/20201

Abstract: Examples are described that relate to correcting line bias in images. One example provides a method comprising receiving, from an imaging device, a plurality of images each comprising a plurality of lines of pixels. The method further comprises, for each image of the plurality of images, for each line of pixels of the plurality of lines of pixels, based at least on one or more pixel values of one or more pixels in the line of pixels, determining a line bias correction for the line, and applying the line bias correction to each pixel in the line, the line bias correction comprising an offset applied to each pixel value in the line of pixels.

公开(公告)号：US11563041B2

公开(公告)日：2023-01-24

申请号：US17356326

申请日：2021-06-23

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Raymond Kirk Price ,  Kai Zang ,  Michael Bleyer

IPC: H01L27/146 ,  H04N5/232 ,  H04N5/378 ,  H04N5/353 ,  H04N5/355 ,  H04N9/04

Abstract: Optimizations are provided for a high dynamic range (HDR) sensor. This sensor is a spatially multiplexed image sensor that includes at least two sets of red, green, and blue (RGB) pixels. Each red pixel in the second set of RGB pixels is positioned proximately and sometimes, adjacently, to at least one red pixel in the first set of RGB pixels. Each green pixel in the second set of RGB pixels is positioned proximately to at least one green pixel in the first set of RGB pixels. Each blue pixel in the second set of RGB pixels is positioned proximately to at least one blue pixel in the first set of RGB pixel. This spatially multiplexed image sensor is able to generate a digital image with reduced motion blurring artifacts.