CORRECTING PIXEL DEFECTS BASED ON DEFECT HISTORY IN AN IMAGE PROCESSING PIPELINE

    公开(公告)号:US20200084401A1

    公开(公告)日:2020-03-12

    申请号:US16593900

    申请日:2019-10-04

    Applicant: Apple Inc.

    Abstract: An image signal processor may include a pixel defect correction component that tracks defect history for frames captured by an image sensor and applies the history when identifying and correcting defective pixels in a frame. The component maintains a defect pixel location table that includes a defect confidence value for pixels of the image sensor. The component identifies defective pixels in a frame, for example by comparing each pixel's value to the values of its neighbor pixels. If a pixel is detected as defective, its defect confidence value may be incremented. Otherwise, the value may be decremented. If a pixel's defect confidence value is over a defect confidence threshold, the pixel is considered defective and thus may be corrected. If a pixel's defect confidence value is under the threshold, the pixel is considered not defective and thus may not be corrected even if the pixel was detected as defective.

    Automatic compensation of lens flare

    公开(公告)号:US10298863B2

    公开(公告)日:2019-05-21

    申请号:US14848276

    申请日:2015-09-08

    Applicant: Apple Inc.

    Abstract: Systems and methods for automatic lens flare compensation may include a non-uniformity detector configured to operate on pixel data for an image in an image sensor color pattern. The non-uniformity detector may detect a non-uniformity in the pixel data in a color channel of the image sensor color pattern. The non-uniformity detector may generate output including location and magnitude values of the non-uniformity. A lens flare detector may determine, based at least on the location and magnitude values, whether the output of the non-uniformity detector corresponds to a lens flare in the image. In some embodiments, the lens flare detector may generate, in response to determining that the output corresponds to the lens flare, a representative map of the lens flare. A lens flare corrector may determine one or more pixel data correction values corresponding to the lens flare and apply the pixel data correction values to the pixel data.

    Minimizing a data pedestal level in an image sensor

    公开(公告)号:US10205898B2

    公开(公告)日:2019-02-12

    申请号:US14882361

    申请日:2015-10-13

    Applicant: Apple Inc.

    Abstract: A pedestal level for an image sensor can be dynamically adjusted based on one or more parameters. The parameters include one or more operating conditions associated with the image sensor, pre-determined image sensor characterization data, the number of unused digital codes, and/or the number of clipped pixel signals. The operating conditions can include the temperature of the image sensor, the gain of at least one amplifier included in processing circuitry operably connected to at least one pixel, and/or the length of the integration period for at least one pixel in the image sensor. Based on the one or more of the parameters, the pedestal level is adjusted to reduce a number of unused digital codes in a distribution of dark current. Additionally or alternatively, the variance of the pixel signals can be reduced to permit the use of a lower pedestal level.

    Configurable Convolution Engine
    7.
    发明申请

    公开(公告)号:US20180082400A1

    公开(公告)日:2018-03-22

    申请号:US15823292

    申请日:2017-11-27

    Applicant: Apple Inc.

    CPC classification number: G06F17/153 G06T5/001 G06T5/20

    Abstract: Embodiments of the present disclosure relate to a configurable convolution engine that receives configuration information to perform convolution or its variant operations on streaming input data of various formats. To process streaming input data, input data of multiple channels are received and stored in an input buffer circuit in an interleaved manner. Data values of the interleaved input data are retrieved and forwarded to multiplier circuits where multiplication with a corresponding filter element of a kernel is performed. Varying number of kernels with different sizes and sparsity can also be used for the convolution operations.

    Configurable convolution engine
    8.
    发明授权

    公开(公告)号:US09858636B1

    公开(公告)日:2018-01-02

    申请号:US15198478

    申请日:2016-06-30

    Applicant: Apple Inc.

    CPC classification number: G06F17/153

    Abstract: Embodiments of the present disclosure relate to a configurable convolution engine that receives configuration information to perform convolution or its variant operations on streaming input data of various formats. To process streaming input data, input data of multiple channels are received and stored in an input buffer circuit in an interleaved manner. Data values of the interleaved input data are retrieved and forwarded to multiplier circuits where multiplication with a corresponding filter element of a kernel is performed. Varying number of kernels with different sizes and sparsity can also be used for the convolution operations.

    Pixel defect preprocessing in an image signal processor

    公开(公告)号:US09787922B2

    公开(公告)日:2017-10-10

    申请号:US14841345

    申请日:2015-08-31

    Applicant: Apple Inc.

    CPC classification number: H04N5/367 G06T5/002 G06T5/005 H04N9/735

    Abstract: An image signal processor may include a sensor interface that includes a pixel defect preprocessing (PDP) component that performs an initial adjustment of pixel values for patterned defect pixels in raw pixel data captured by an image sensor. To adjust a patterned defect pixel, the PDP component may apply an interpolation technique to values in a gain lookup table according to the pixel's location in the image frame to determine the gain value for the pixel, and then apply the gain value to the pixel. The PDP component may provide the raw pixel data with the adjusted patterned defect pixels to two or more other modules for additional processing. The other modules may include an image processing pipeline that may detect other defective pixels in the raw pixel data and correct the patterned defect pixels and the other defective pixels, for example using a weighted combination of neighboring pixels.

Patent Agency Ranking