-
公开(公告)号：US20220254050A1
公开(公告)日：2022-08-11
申请号：US17173094
申请日：2021-02-10
Applicant: Apple Inc.
Inventor： Maxim Smirnov , Sheng Lin
Abstract: Embodiments relate to an image processing circuit comprising a noise reduction circuit configurable to perform bilateral filtering on demosaiced and resampled image data, or on raw image data, based on the operating mode of the image processing circuit. The noise reduction circuit filters received image data based upon directional taps, by selecting, for each pixel, a set of neighbor pixels, and comparing values of the set of neighbor pixels to determine whether the pixel lies on a directional edge. For raw images, the noise reduction circuit selects the set of neighbor pixels to include a plurality of pixels of the same color channel as the pixel, and one or more additional pixels of a different color channel, where color values for the one or more additional pixels are determined by interpolating color values of two or more adjacent pixels of the same color channel as the pixel.
-
公开(公告)号：US20210360176A1
公开(公告)日：2021-11-18
申请号：US17334409
申请日：2021-05-28
Applicant: Apple Inc.
Inventor： Sheng Lin , D. Amnon Silverstein
Abstract: Embodiments relate to image signal processors (ISP) that include binner circuits that down-sample an input image. An input image may include a plurality of pixels. The output image of the binner circuit may include a reduced number of pixels. The binner circuit may include a plurality of different operation modes. In a bin mode, the binner circuit may blend a subset of input pixel values to generate an output pixel quad. In a skip mode, the binner circuit may select one of the input pixel values as the output pixel pixel. The selection may be performed randomly to avoid aliasing. In a luminance mode, the binner circuit may take a weighted average of a subset of pixel values having different colors. In a color value mode, the binner circuit may select one of the colors in a subset of pixel values as an output pixel value.
-
公开(公告)号：US20210342981A1
公开(公告)日：2021-11-04
申请号：US16865883
申请日：2020-05-04
Applicant: Apple Inc.
Inventor： Sheng Lin
Abstract: Embodiments relate to axial chromatic aberration (ACA) reduction of raw image data generated by image sensors. A chromatic aberration reduction circuit performs chromatic aberration reduction on the raw image data to correct the ACA in the full color images through sharpening that has been clamped to reduce sharpening overshoot.
-
公开(公告)号：US11025842B2
公开(公告)日：2021-06-01
申请号：US16376426
申请日：2019-04-05
Applicant: Apple Inc.
Inventor： Sheng Lin , D. Amnon Silverstein
Abstract: Embodiments relate to image signal processors (ISP) that include binner circuits that down-sample an input image. An input image may include a plurality of pixels. The output image of the binner circuit may include a reduced number of pixels. The binner circuit may include a plurality of different operation modes. In a bin mode, the binner circuit may blend a subset of input pixel values to generate an output pixel quad. In a skip mode, the binner circuit may select one of the input pixel values as the output pixel pixel. The selection may be performed randomly to avoid aliasing. In a luminance mode, the binner circuit may take a weighted average of a subset of pixel values having different colors. In a color value mode, the binner circuit may select one of the colors in a subset of pixel values as an output pixel value.
-
公开(公告)号：US11023994B2
公开(公告)日：2021-06-01
申请号：US16376414
申请日：2019-04-05
Applicant: Apple Inc.
Inventor： Sheng Lin , David R. Pope , D. Amnon Silverstein
Abstract: Embodiments relate to image signal processors (ISP) that include one or more auto-focus circuits. Each of the auto-focus circuits may be connected to an image sensor and may be separate from a statistics circuit and other image processing pipelines of the ISP. An image sensor may include one or more focus pixels that are used to generate data for auto-focusing. The auto-focus circuit may extract the focus pixel values and generate a signal to control the lens position of the image sensor. Each image sensor may include a separate auto-focus circuit. When other image processing pipelines of the ISP are processing the image data from one image sensor, the auto-focus circuit for another image sensor may continue to generate focus signals that control the lens position of the other image sensor. The other image sensor may be in standby but may continue to remain in focus.
-
Patent Agency Ranking
公开(公告)号：US10991083B2
公开(公告)日：2021-04-27
申请号：US17020626
申请日：2020-09-14
Applicant: Apple Inc.
Inventor： Sheng Lin , Maxim Smirnov , David R. Pope , Farhan Baqai
Abstract: Embodiments relate to a bilateral filter circuit for directional filtering of an image. The directional bilateral filter circuit determines an edge direction and a weight for the edge direction by processing differences between pixel values of pixels in a first block of pixels in the image. The bilateral filter circuit determines non-directional taps for pixels in a second block by processing pixel locations, and determines directional taps by processing differences between pixel values, gradient information for the second block and the edge direction. The bilateral filter circuit determines final filter taps for pixels in the second block by blending corresponding non-directional taps and directional taps using the weight. The bilateral filter circuit obtains a pixel value of a filtered image by multiplying the final filter taps to corresponding pixel values of the pixels in the second block and adding the multiplied values.
-
公开(公告)号：US20200294199A1
公开(公告)日：2020-09-17
申请号：US16352801
申请日：2019-03-13
Applicant: Apple Inc.
Inventor： Sheng Lin , David R. Pope
Abstract: Embodiments relate to directional bilateral filtering of a raw image. For each pixel in the image, a block of pixels surrounding that pixel is used for filtering. When the block of pixels in a Bayer pattern have directionality, directional filter coefficients are used instead of default filter coefficients. To obtain a directional tap, a directional filter coefficient is attenuated by an attenuation factor that differs based at least on the location of the pixels in the pixel block. The directional taps are blended with non-directional taps derived from the default filter coefficients using a weight representing confidence on the directionality. The filtered pixel values are then obtained by multiplying pixel values with corresponding taps.
-
公开(公告)号：US10554914B1
公开(公告)日：2020-02-04
申请号：US16101154
申请日：2018-08-10
Applicant: Apple Inc.
Inventor： Sheng Lin , David R. Pope
Abstract: Embodiments relate to a pixel defect detection circuit for detecting and correcting defective pixels in captured image frames. The pixel defect detection circuit includes a defect pixel location table that maps pixel locations in an image frame to respective confidence values, each confidence value indicating a likelihood that a corresponding pixel is defective. The pixel defect detection circuit further includes a dynamic defect processing circuit configured to determine whether a first pixel of an image frame is defective, and a flatness detection circuit configured to determine whether the first pixel is in a flat region of the image frame. The confidence value corresponding to the location of the first pixel is updated based upon whether the first pixel is determined be defective if the first pixel is determined to be in a flat region, and not updated if the first pixel is determined to not be in a flat region.
-
公开(公告)号：US10467496B2
公开(公告)日：2019-11-05
申请号：US14841412
申请日：2015-08-31
Applicant: Apple Inc.
Inventor： Suk Hwan Lim , D. Amnon Silverstein , Sheng Lin
Abstract: An image processing pipeline may perform temporal filtering on independent color channels in image data. A filter weight may be determined for a given pixel received at a temporal filter. The filter weight may be determined for blending a value of a channel in a full color encoding of the given pixel with a value of the same channel for a corresponding pixel in a previously filtered reference image frame. In some embodiments, the filtering strength for the channel may be determined independent from the filtering strength of another channel in the full color encoding of the given pixel. Spatial filtering may be applied to a filtered version of the given pixel prior to storing the given pixel as part of a new reference image frame.
-
公开(公告)号：US20160037061A1
公开(公告)日：2016-02-04
申请号：US14449016
申请日：2014-07-31
Applicant: Apple Inc.
Inventor： Suk Hwan Lim , D. Amnon Silverstein , Sheng Lin
CPC classification number: H04N5/23229 , G06T5/002 , G06T5/10 , G06T7/20 , G06T2207/20182 , G06T2207/20201 , H04N5/23254 , H04N5/23267 , H04N9/045
Abstract: A temporal filter may perform dynamic motion estimation and compensation for filtering an image frame. A row of pixels in an image frame received for processing at the temporal filter may be received. A motion estimate may be dynamically determined that registers a previously filtered reference image frame with respect to the row of pixels in the image frame. The reference image frame may be aligned according to the determined motion estimate, and pixels in the row of the image frame may be blended with corresponding pixels in the aligned reference image frame to generate a filtered version of the image frame. Motion statistics may be collected for subsequent processing based on the motion estimation and alignment for the row of pixels in the image frame.
Abstract translation: 时间滤波器可以执行用于过滤图像帧的动态运动估计和补偿。 可以接收用于在时间滤波器处理的图像帧中的像素行。 可以动态地确定运动估计，其相对于图像帧中的像素行注册先前滤波的参考图像帧。 可以根据确定的运动估计来对准参考图像帧，并且可以将图像帧的行中的像素与对准的参考图像帧中的对应像素混合以生成图像帧的滤波版本。 可以基于图像帧中的像素行的运动估计和对准来收集运动统计信息用于后续处理。
-
-
-
-
-
-
-
-
-
Search Results
71
records
(took 0.032 seconds)
