公开(公告)号：US11265490B2

公开(公告)日：2022-03-01

申请号：US16901490

申请日：2020-06-15

Applicant: Apple Inc.

Inventor： Ilya Romanenko ,  Alex Hayes

IPC: H04N5/357 ,  H04N5/21 ,  H04N5/33 ,  G06T5/00 ,  G06K9/00

Abstract: Devices, methods, and non-transitory program storage devices for spatiotemporal image noise reduction are disclosed, comprising: maintaining an accumulated image in memory; and obtaining a first plurality of multispectral images (e.g., RGB-IR images). For each image in the first plurality of multispectral images, the method may: calculate a multispectral guide image for the current image; calculate blending weights for the current image; apply the calculated blending weights to each channel of the current image to generate a denoised current image; and update the accumulated image based on pixel differences between the denoised current image and the accumulated image. In some embodiments, additional images (e.g., the accumulated image and/or other images captured prior to or after a given current image) may also be included in the denoising operations for a given current image. Finally, the method may generate a denoised output image for each input image, based on the updated accumulated image.

公开(公告)号：US11323676B2

公开(公告)日：2022-05-03

申请号：US16901448

申请日：2020-06-15

Applicant: Apple Inc.

Inventor： Ilya Romanenko ,  Roberto Montagna

IPC: H04N9/73 ,  H04N5/235

Abstract: One limitation of traditional imaging systems is that they are only programmed to correct for a single color of illuminant in a scene. In multi-illuminant scenes, the detected illuminant color may correspond to some mixture of scene illuminants. This may lead to incomplete color correction, wherein, e.g., the dominant illuminant is corrected for but the color cast caused by secondary illuminants is still visible, or an at least partially visible color cast remains from multiple of the scene illuminants. Thus, the techniques disclosed herein comprise: obtaining an image of a scene; generating an illumination map for the obtained image; dividing the values in the illumination map to determine a number of estimated illuminant regions, wherein each region corresponds to at least one estimated illuminant present in the captured scene; estimating a white point for each region; and applying white balancing operations, based on the estimated white points for each region.

公开(公告)号：US11388355B2

公开(公告)日：2022-07-12

申请号：US16900621

申请日：2020-06-12

Applicant: Apple Inc.

Inventor： Alex Hayes ,  Ilya Romanenko

IPC: G06T5/00 ,  H04N5/33 ,  G06T7/10 ,  G06T5/50

Abstract: Devices, methods, and non-transitory program storage devices are disclosed herein to provide improved multi-spectral image processing techniques for generating an enhanced output image, the techniques comprising: obtaining an N-channel (e.g., multispectral) input image; determining fusion weights and fallback weights (e.g., relative intensity weights) for each of the N-channels of the input image; blending the fusion and fallback weights based on an amount of gradient information to generate blended weights; modulating the blended weights for a plurality of frequency band representations of the input image; applying the modulated blended weights to the corresponding frequency band representations of the input image to generate a plurality of output image frequency band representations; producing an output luma image, based on the plurality of output image frequency band representations; and generating an output RGB image, based on the output luma image, which may then, e.g., be displayed to a user or stored to non-volatile memory.