Temporal Multi-Band Noise Reduction
    2.
    发明申请
    Temporal Multi-Band Noise Reduction 有权
    时域多波段降噪

    公开(公告)号:US20170069060A1

    公开(公告)日:2017-03-09

    申请号:US14872104

    申请日:2015-09-30

    Applicant: Apple Inc.

    Abstract: Systems, methods, and computer readable media to fuse digital images are described. In general, techniques are disclosed that use multi-band noise reduction techniques to represent input and reference images as pyramids. Once decomposed in this manner, images may be fused using novel low-level (noise dependent) similarity measures. In some implementations similarity measures may be based on intra-level comparisons between reference and input images. In other implementations, similarity measures may be based on inter-level comparisons. In still other implementations, mid-level semantic features such as black-level may be used to inform the similarity measure. In yet other implementations, high-level semantic features such as color or a specified type of region (e.g., moving, stationary, or having a face or other specified shape) may be used to inform the similarity measure.

    Abstract translation: 描述了融合数字图像的系统,方法和计算机可读介质。 通常,公开了使用多频带降噪技术将输入和参考图像表示为金字塔的技术。 一旦以这种方式分解,可以使用新颖的低级(噪声依赖)相似性度量来融合图像。 在一些实现中,相似性度量可以基于参考和输入图像之间的层内比较。 在其他实现中,相似性度量可以基于层间比较。 在其他实现中,可以使用诸如黑色级别的中级语义特征来通知相似性度量。 在其他实现中,可以使用诸如颜色或指定类型的区域(例如,移动,静止或具有面部或其他指定形状)的高级语义特征来通知相似性度量。

    Subject-aware low light photography

    公开(公告)号:US11570374B1

    公开(公告)日:2023-01-31

    申请号:US17357501

    申请日:2021-06-24

    Applicant: Apple Inc.

    Abstract: Devices, methods, and computer-readable media are disclosed, describing an adaptive, subject-aware approach for image bracket selection and fusion, e.g., to generate high quality images in a wide variety of capturing conditions, including low light conditions. An incoming image stream may be obtained from an image capture device, comprising images captured using differing default exposure values, e.g., according to a predetermined pattern. When a capture request is received, it may be detected whether one or more human or animal subjects are present in the incoming image stream. If a subject is detected, an exposure time of one or more images selected from the incoming image stream may be reduced relative to its default exposure time. Prior to the fusion operation, one of the selected images may be designated a reference image for the fusion operation based, at least in part, on a sharpness score and/or a blink score of the image.

    Generalized fusion techniques based on minimizing variance and asymmetric distance measures

    公开(公告)号:US11189017B1

    公开(公告)日:2021-11-30

    申请号:US16563273

    申请日:2019-09-06

    Applicant: Apple Inc.

    Abstract: Devices, methods, and computer-readable media describing an adaptive approach for image selection, fusion, and noise reduction, e.g., to generate low noise and high dynamic range (HDR) images with improved motion freezing in a variety of capturing conditions. An incoming image stream may be obtained from an image capture device, wherein the image stream comprises a variety of differently-exposed captures, e.g., EV0 images, EV− images, EV+ images. When a capture request is received, a set of rules may be used to evaluate one or more capture conditions associated with the images from the incoming image stream and determine which two or more images to select for a fusion operation. The fusion operation may be designed to adaptively fuse the selected images, e.g., in a fashion that is determined to be optimal from a noise variance minimization standpoint. A fusion-adaptive noise reduction process may further be performed on the resultant fused image.

    Hybrid image registration techniques

    公开(公告)号:US11776141B1

    公开(公告)日:2023-10-03

    申请号:US17357401

    申请日:2021-06-24

    Applicant: Apple Inc.

    Abstract: Devices, methods, and non-transitory program storage devices (NPSDs) for an improved, so-called “hybrid” image registration process are disclosed herein, comprising: obtaining a first set of captured images, wherein the first set of captured images comprises a reference image and one or more bracketed images; and for each of the one or more bracketed images: performing a first (e.g., global) registration operation and a second (e.g., dense, or other localized) registration operation on the bracketed image with respect to the reference image, wherein each of the first and second registration operations produces an output; generating a blend map for the bracketed image, wherein each value in the blend map indicates whether to use the first or second registration operation output for a corresponding one or more pixels when registering the bracketed image with the reference image; and registering the bracketed image with the reference image, according to the generated blend map.

    Advanced Multi-Band Noise Reduction
    8.
    发明申请
    Advanced Multi-Band Noise Reduction 有权
    高级多频带降噪

    公开(公告)号:US20170070718A1

    公开(公告)日:2017-03-09

    申请号:US14872098

    申请日:2015-09-30

    Applicant: Apple Inc.

    Abstract: Techniques for de-noising a digital image using a multi-band noise filter and a unique combination of texture and chroma metrics are described. A novel texture metric may be used during multi-band filter operations on an image's luma channel to determine if a given pixel is associated with a textured/smooth region of the image. A novel chroma metric may be used during the the same multi-band filter operation to determine if the same pixel is associated with a blue/not-blue region of the image. Pixels identified as being associated with a smooth blue region may be aggressively de-noised and conservatively sharpened. Pixels identified as being associated with a textured blue region may be conservatively de-noised and aggressively sharpened. By coupling texture and chroma constraints it has been shown possible to mitigate noise in an image's smooth blue regions without affecting the edges/texture in other blue objects.

    Abstract translation: 描述了使用多频带噪声滤波器去噪数字图像和纹理和色度度量的唯一组合的技术。 在图像的亮度信道的多频带滤波操作期间可以使用新的纹理度量,以确定给定像素是否与图像的纹理/平滑区域相关联。 在相同的多频带滤波器操作期间可以使用新的色度度量以确定相同的像素是否与图像的蓝色/非蓝色区域相关联。 被识别为与平滑蓝色区域相关联的像素可能被积极地去噪和保守地削尖。 识别为与纹理蓝色区域相关联的像素可以被保守地去噪和积极地削尖。 通过耦合纹理和色度约束,已经显示可以减轻图像平滑蓝色区域中的噪声,而不会影响其他蓝色对象中的边缘/纹理。

    Progressive image fusion
    10.
    发明授权

    公开(公告)号:US11113802B1

    公开(公告)日:2021-09-07

    申请号:US16564573

    申请日:2019-09-09

    Applicant: Apple Inc.

    Abstract: An adaptive approach to image bracket determination and a more memory-efficient approach to image fusion, which are designed to generate low noise and high dynamic range (HDR) images in a wide variety of capturing conditions, are described. An incoming preview image stream may be obtained from an image capture device. When a capture request is received, an analysis may be performed on an image from the preview image stream that has a predetermined temporal relationship to the image capture request. Based on the analysis, a set of images (and their respective capture parameters, e.g., exposure time) may be determined for the image capture device to capture. As the determined set of images are captured, they may be registered and fused in a memory-efficient manner that, e.g., places an upper limit on the overall memory footprint of the registration and fusion operations—regardless of how many images are captured in total.

Patent Agency Ranking