CONTENT BASED IMAGE PROCESSING
    3.
    发明申请

    公开(公告)号:US20230020964A1

    公开(公告)日:2023-01-19

    申请号:US17950917

    申请日:2022-09-22

    申请人: Apple Inc.

    IPC分类号: G06T5/00 G06T7/10 G06T3/40

    摘要: Some embodiments relate to sharpening segments of an image differently based on content in the image. Content based sharpening is performed by a content image processing circuit that receives luminance values of an image and a content map. The content map identifies categories of content in segments of the image. Based on one or more of the identified categories of content, the circuit determines a content factor associated with a pixel. The content factor may also be based on a texture and/or chroma values. A texture value indicates a likelihood of a category of content and is based on detected edges in the image. A chroma value indicates a likelihood of a category of content and is based on color information of the image. The circuit receives the content factor and applies it to a version of the luminance value of the pixel to generate a sharpened version of the luminance value.

    Binner circuit for image signal processor

    公开(公告)号:US11375140B2

    公开(公告)日:2022-06-28

    申请号:US17334409

    申请日:2021-05-28

    申请人: Apple Inc.

    摘要: Embodiments relate to image signal processors (ISP) that include binner circuits that down-sample an input image. An input image may include a plurality of pixels. The output image of the binner circuit may include a reduced number of pixels. The binner circuit may include a plurality of different operation modes. In a bin mode, the binner circuit may blend a subset of input pixel values to generate an output pixel quad. In a skip mode, the binner circuit may select one of the input pixel values as the output pixel pixel. The selection may be performed randomly to avoid aliasing. In a luminance mode, the binner circuit may take a weighted average of a subset of pixel values having different colors. In a color value mode, the binner circuit may select one of the colors in a subset of pixel values as an output pixel value.

    BINNER CIRCUIT FOR IMAGE SIGNAL PROCESSOR
    6.
    发明申请

    公开(公告)号:US20200322549A1

    公开(公告)日:2020-10-08

    申请号:US16376426

    申请日:2019-04-05

    申请人: Apple Inc.

    摘要: Embodiments relate to image signal processors (ISP) that include binner circuits that down-sample an input image. An input image may include a plurality of pixels. The output image of the binner circuit may include a reduced number of pixels. The binner circuit may include a plurality of different operation modes. In a bin mode, the binner circuit may blend a subset of input pixel values to generate an output pixel quad. In a skip mode, the binner circuit may select one of the input pixel values as the output pixel pixel. The selection may be performed randomly to avoid aliasing. In a luminance mode, the binner circuit may take a weighted average of a subset of pixel values having different colors. In a color value mode, the binner circuit may select one of the colors in a subset of pixel values as an output pixel value.

    CORRECTING PIXEL DEFECTS BASED ON DEFECT HISTORY IN AN IMAGE PROCESSING PIPELINE

    公开(公告)号:US20200084401A1

    公开(公告)日:2020-03-12

    申请号:US16593900

    申请日:2019-10-04

    申请人: Apple Inc.

    IPC分类号: H04N5/367 H04N5/217

    摘要: An image signal processor may include a pixel defect correction component that tracks defect history for frames captured by an image sensor and applies the history when identifying and correcting defective pixels in a frame. The component maintains a defect pixel location table that includes a defect confidence value for pixels of the image sensor. The component identifies defective pixels in a frame, for example by comparing each pixel's value to the values of its neighbor pixels. If a pixel is detected as defective, its defect confidence value may be incremented. Otherwise, the value may be decremented. If a pixel's defect confidence value is over a defect confidence threshold, the pixel is considered defective and thus may be corrected. If a pixel's defect confidence value is under the threshold, the pixel is considered not defective and thus may not be corrected even if the pixel was detected as defective.

    Autofocusing images using motion detection

    公开(公告)号:US10567787B1

    公开(公告)日:2020-02-18

    申请号:US16100809

    申请日:2018-08-10

    申请人: Apple, Inc.

    摘要: Embodiments of the present disclosure relate to autofocusing of images using motion vectors generated by an image signal processor of a device. An image being processed may include one or more motion detection windows associated with a motion vector as well as one or more autofocus windows. An autofocus window that follows a motion detection window by at least a threshold vertical distance may be selected, for example, to account for a period of time or latency for determining a motion vector of the motion detection window. The device may perform autofocusing by shifting location of the selected autofocus window.

    Automatic compensation of lens flare

    公开(公告)号:US10298863B2

    公开(公告)日:2019-05-21

    申请号:US14848276

    申请日:2015-09-08

    申请人: Apple Inc.

    摘要: Systems and methods for automatic lens flare compensation may include a non-uniformity detector configured to operate on pixel data for an image in an image sensor color pattern. The non-uniformity detector may detect a non-uniformity in the pixel data in a color channel of the image sensor color pattern. The non-uniformity detector may generate output including location and magnitude values of the non-uniformity. A lens flare detector may determine, based at least on the location and magnitude values, whether the output of the non-uniformity detector corresponds to a lens flare in the image. In some embodiments, the lens flare detector may generate, in response to determining that the output corresponds to the lens flare, a representative map of the lens flare. A lens flare corrector may determine one or more pixel data correction values corresponding to the lens flare and apply the pixel data correction values to the pixel data.

    Dynamically determining filtering strength for noise filtering in image processing

    公开(公告)号:US10269095B2

    公开(公告)日:2019-04-23

    申请号:US14841384

    申请日:2015-08-31

    申请人: Apple Inc.

    摘要: An image processing pipeline may dynamically determine filtering strengths for noise filtering of image data. Statistics may be collected for an image at an image processing pipeline. The statistics may be accessed and evaluated to generate a filter strength model that maps respective filtering strengths to different portions of the image. A noise filter may determine a filtering strength for image data received at the noise filter according to the filter strength model. The noise filter may then apply a filtering technique according to the determined filtering strength.