-
公开(公告)号:US20200084401A1
公开(公告)日:2020-03-12
申请号:US16593900
申请日:2019-10-04
Applicant: Apple Inc.
Inventor: Sheng Lin , D. Amnon Silverstein , David R. Pope , Suk Hwan Lim
Abstract: An image signal processor may include a pixel defect correction component that tracks defect history for frames captured by an image sensor and applies the history when identifying and correcting defective pixels in a frame. The component maintains a defect pixel location table that includes a defect confidence value for pixels of the image sensor. The component identifies defective pixels in a frame, for example by comparing each pixel's value to the values of its neighbor pixels. If a pixel is detected as defective, its defect confidence value may be incremented. Otherwise, the value may be decremented. If a pixel's defect confidence value is over a defect confidence threshold, the pixel is considered defective and thus may be corrected. If a pixel's defect confidence value is under the threshold, the pixel is considered not defective and thus may not be corrected even if the pixel was detected as defective.
-
公开(公告)号:US10298863B2
公开(公告)日:2019-05-21
申请号:US14848276
申请日:2015-09-08
Applicant: Apple Inc.
Inventor: D. Amnon Silverstein , Sheng Lin , David R. Pope , Suk Hwan Lim
Abstract: Systems and methods for automatic lens flare compensation may include a non-uniformity detector configured to operate on pixel data for an image in an image sensor color pattern. The non-uniformity detector may detect a non-uniformity in the pixel data in a color channel of the image sensor color pattern. The non-uniformity detector may generate output including location and magnitude values of the non-uniformity. A lens flare detector may determine, based at least on the location and magnitude values, whether the output of the non-uniformity detector corresponds to a lens flare in the image. In some embodiments, the lens flare detector may generate, in response to determining that the output corresponds to the lens flare, a representative map of the lens flare. A lens flare corrector may determine one or more pixel data correction values corresponding to the lens flare and apply the pixel data correction values to the pixel data.
-
公开(公告)号:US10269095B2
公开(公告)日:2019-04-23
申请号:US14841384
申请日:2015-08-31
Applicant: Apple Inc.
Inventor: Suk Hwan Lim , D. Amnon Silverstein
Abstract: An image processing pipeline may dynamically determine filtering strengths for noise filtering of image data. Statistics may be collected for an image at an image processing pipeline. The statistics may be accessed and evaluated to generate a filter strength model that maps respective filtering strengths to different portions of the image. A noise filter may determine a filtering strength for image data received at the noise filter according to the filter strength model. The noise filter may then apply a filtering technique according to the determined filtering strength.
-
公开(公告)号:US10205898B2
公开(公告)日:2019-02-12
申请号:US14882361
申请日:2015-10-13
Applicant: Apple Inc.
Inventor: Andrew Kenneth John McMahon , D. Amnon Silverstein , David R. Pope , Suk Hwan Lim
Abstract: A pedestal level for an image sensor can be dynamically adjusted based on one or more parameters. The parameters include one or more operating conditions associated with the image sensor, pre-determined image sensor characterization data, the number of unused digital codes, and/or the number of clipped pixel signals. The operating conditions can include the temperature of the image sensor, the gain of at least one amplifier included in processing circuitry operably connected to at least one pixel, and/or the length of the integration period for at least one pixel in the image sensor. Based on the one or more of the parameters, the pedestal level is adjusted to reduce a number of unused digital codes in a distribution of dark current. Additionally or alternatively, the variance of the pixel signals can be reduced to permit the use of a lower pedestal level.
-
公开(公告)号:US20180232600A1
公开(公告)日:2018-08-16
申请号:US15954103
申请日:2018-04-16
Applicant: Apple Inc.
Inventor: Suk Hwan Lim , Jaewon Shin
CPC classification number: G06K9/6212 , G06K9/4604 , G06K9/4642
Abstract: Embodiments relate to a histogram-of-oriented gradients (HOG) module. The HOG module is implemented in hardware rather than software. The HOG module applies an algorithm to an image to identify gradient orientation in localized portions of the image. The HOG module creates a histogram-of orientation gradients based on the identified gradient orientations.
-
公开(公告)号:US09979942B2
公开(公告)日:2018-05-22
申请号:US15198552
申请日:2016-06-30
Applicant: Apple Inc.
Inventor: Suk Hwan Lim , D. Amnon Silverstein , David R. Pope
CPC classification number: H04N9/646 , G06T1/20 , G06T3/4007 , G06T3/4015 , H04N9/04 , H04N9/045 , H04N9/67 , H04N9/76
Abstract: Embodiments relate to color correction circuit operations performed by an image signal processor. The color correction circuit computes optimal color correction matrix on a per-pixel basis and adjusts it based on relative noise standard deviations of the color channels to steer the matrix.
-
公开(公告)号:US20180082400A1
公开(公告)日:2018-03-22
申请号:US15823292
申请日:2017-11-27
Applicant: Apple Inc.
Inventor: Suk Hwan Lim , Junji Sugisawa , Muge Wang
CPC classification number: G06F17/153 , G06T5/001 , G06T5/20
Abstract: Embodiments of the present disclosure relate to a configurable convolution engine that receives configuration information to perform convolution or its variant operations on streaming input data of various formats. To process streaming input data, input data of multiple channels are received and stored in an input buffer circuit in an interleaved manner. Data values of the interleaved input data are retrieved and forwarded to multiplier circuits where multiplication with a corresponding filter element of a kernel is performed. Varying number of kernels with different sizes and sparsity can also be used for the convolution operations.
-
公开(公告)号:US09858636B1
公开(公告)日:2018-01-02
申请号:US15198478
申请日:2016-06-30
Applicant: Apple Inc.
Inventor: Suk Hwan Lim , Junji Sugisawa , Muge Wang
CPC classification number: G06F17/153
Abstract: Embodiments of the present disclosure relate to a configurable convolution engine that receives configuration information to perform convolution or its variant operations on streaming input data of various formats. To process streaming input data, input data of multiple channels are received and stored in an input buffer circuit in an interleaved manner. Data values of the interleaved input data are retrieved and forwarded to multiplier circuits where multiplication with a corresponding filter element of a kernel is performed. Varying number of kernels with different sizes and sparsity can also be used for the convolution operations.
-
公开(公告)号:US09787922B2
公开(公告)日:2017-10-10
申请号:US14841345
申请日:2015-08-31
Applicant: Apple Inc.
Inventor: Sheng Lin , Suk Hwan Lim
Abstract: An image signal processor may include a sensor interface that includes a pixel defect preprocessing (PDP) component that performs an initial adjustment of pixel values for patterned defect pixels in raw pixel data captured by an image sensor. To adjust a patterned defect pixel, the PDP component may apply an interpolation technique to values in a gain lookup table according to the pixel's location in the image frame to determine the gain value for the pixel, and then apply the gain value to the pixel. The PDP component may provide the raw pixel data with the adjusted patterned defect pixels to two or more other modules for additional processing. The other modules may include an image processing pipeline that may detect other defective pixels in the raw pixel data and correct the patterned defect pixels and the other defective pixels, for example using a weighted combination of neighboring pixels.
-
公开(公告)号:US09741099B2
公开(公告)日:2017-08-22
申请号:US14822316
申请日:2015-08-10
Applicant: APPLE INC.
Inventor: Suk Hwan Lim , D. Amnon Silverstein , Guy Cote , Steven David Hordley , Graham Finlayson , Weichun Ku , Joseph P. Bratt
CPC classification number: G06T5/001 , G06K9/38 , G06T1/20 , G06T5/002 , G06T5/003 , G06T5/008 , G06T5/50 , G06T2207/10024 , G06T2207/20012 , G06T2207/20028 , G06T2207/20208
Abstract: Systems and methods for local tone mapping are provided. In one example, an electronic device includes an electronic display, an imaging device, and an image signal processor. The electronic display may display images of a first bit depth, and the imaging device may include an image sensor that obtains image data of a higher bit depth than the first bit depth. The image signal processor may process the image data, and may include local tone mapping logic that may apply a spatially varying local tone curve to a pixel of the image data to preserve local contrast when displayed on the display. The local tone mapping logic may smooth the local tone curve applied to the intensity difference between the pixel and another nearby pixel exceeds a threshold.
-
-
-
-
-
-
-
-
-