-
公开(公告)号：US20170064227A1
公开(公告)日：2017-03-02
申请号：US14841345
申请日：2015-08-31
Applicant: Apple Inc.
Inventor： Sheng Lin , Suk Hwan Lim
Abstract: An image signal processor may include a sensor interface that includes a pixel defect preprocessing (PDP) component that performs an initial adjustment of pixel values for patterned defect pixels in raw pixel data captured by an image sensor. To adjust a patterned defect pixel, the PDP component may apply an interpolation technique to values in a gain lookup table according to the pixel's location in the image frame to determine the gain value for the pixel, and then apply the gain value to the pixel. The PDP component may provide the raw pixel data with the adjusted patterned defect pixels to two or more other modules for additional processing. The other modules may include an image processing pipeline that may detect other defective pixels in the raw pixel data and correct the patterned defect pixels and the other defective pixels, for example using a weighted combination of neighboring pixels.
Abstract translation: 图像信号处理器可以包括传感器接口，该传感器接口包括对由图像传感器捕获的原始像素数据中的图案化缺陷像素执行像素值的初始调整的像素缺陷预处理（PDP）组件。 为了调整图案化的缺陷像素，PDP部件可以根据图像帧中的像素的位置对增益查找表中的值应用内插技术，以确定像素的增益值，然后将该增益值应用于像素。 PDP组件可以将经调整的图案化缺陷像素的原始像素数据提供给两个或更多个其他模块用于附加处理。 其他模块可以包括图像处理流水线，其可以检测原始像素数据中的其他缺陷像素，并且例如使用相邻像素的加权组合来校正图案化的缺陷像素和其它缺陷像素。
-
公开(公告)号：US20170061582A1
公开(公告)日：2017-03-02
申请号：US14841412
申请日：2015-08-31
Applicant: Apple Inc.
Inventor： Suk Hwan Lim , D. Amnon Silverstein , Sheng Lin
CPC classification number: G06K9/6201 , G06T5/002 , G06T2207/20182
Abstract: An image processing pipeline may perform temporal filtering on independent color channels in image data. A filter weight may be determined for a given pixel received at a temporal filter. The filter weight may be determined for blending a value of a channel in a full color encoding of the given pixel with a value of the same channel for a corresponding pixel in a previously filtered reference image frame. In some embodiments, the filtering strength for the channel may be determined independent from the filtering strength of another channel in the full color encoding of the given pixel. Spatial filtering may be applied to a filtered version of the given pixel prior to storing the given pixel as part of a new reference image frame.
Abstract translation: 图像处理流水线可以对图像数据中的独立颜色通道执行时间滤波。 可以针对在时间滤波器处接收到的给定像素来确定滤波器权重。 可以确定滤波器权重用于将给定像素的全色编码中的信道的值与先前滤波的参考图像帧中的对应像素的相同信道的值混合。 在一些实施例中，可以独立于给定像素的全色编码中的另一通道的滤波强度来确定信道的滤波强度。 在将给定像素作为新参考图像帧的一部分存储之前，空间滤波可以应用于给定像素的滤波版本。
-
公开(公告)号：US09584743B1
公开(公告)日：2017-02-28
申请号：US14481820
申请日：2014-09-09
Applicant: Apple Inc.
Inventor： Sheng Lin , Suppawan Kleekajai , Xiangli Li
CPC classification number: H04N5/359 , G06T5/003 , H04N5/23212 , H04N5/3696 , H04N9/045 , H04N17/002
Abstract: A system and method for producing a digital image. The method may compensate for cross-talk between adjacent pixels and reduce the effect of auto-focus elements integrated into a pixel array of an image sensor. A set of coefficients is obtained, where the set of coefficients represent a relative measurement between two or more pixels in the pixel array and may be obtained from a calibration operation. A predictive function is constructed based on the set of coefficients. A compensated pixel value for at least one pixel of the image sensor is calculated using the predictive function. A digital image is created based in part on the compensated value.
Abstract translation: 一种用于产生数字图像的系统和方法。 该方法可以补偿相邻像素之间的串扰，并且减少集成到图像传感器的像素阵列中的自动聚焦元件的影响。 获得一组系数，其中系数集合表示像素阵列中的两个或更多像素之间的相对测量值，并且可以从校准操作获得。 基于一组系数构建预测函数。 使用预测函数计算图像传感器的至少一个像素的补偿像素值。 部分基于补偿值创建数字图像。
-
公开(公告)号：US09219870B1
公开(公告)日：2015-12-22
申请号：US14449005
申请日：2014-07-31
Applicant: Apple Inc.
Inventor： Christopher L. Mills , Sheng Lin , David R. Pope , D. Amnon Silverstein , Suk Hwan Lim
CPC classification number: H04N9/04511 , G06T3/4015 , H04N5/2628 , H04N9/07 , H04N9/646 , H04N2209/046
Abstract: An input rescale module that performs cross-color correlated downscaling of sensor data in the horizontal and vertical dimensions. The module may perform a first-pass demosaic of sensor data, apply horizontal and vertical scalers to resample and downsize the data in the horizontal and vertical dimensions, and then remosaic the data to provide horizontally and vertically downscaled sensor data as output for additional image processing. The module may, for example, act as a front end scaler for an image signal processor (ISP). The demosaic performed by the module may be a relatively simple demosaic, for example a demosaic function that works on 3×3 blocks of pixels. The front end of module may receive and process sensor data at two pixels per clock (ppc); the horizontal filter component reduces the sensor data down to one ppc for downstream components of the input rescale module and for the ISP pipeline.
Abstract translation: 在水平和垂直维度上执行传感器数据的交叉色相关缩小的输入重定标模块。 模块可以执行传感器数据的第一遍去马赛克，应用水平和垂直缩放器对水平和垂直尺寸的数据进行重新采样和缩小，然后重新绘制数据，以提供水平和垂直缩小的传感器数据作为附加图像处理的输出 。 该模块可以例如用作图像信号处理器（ISP）的前端缩放器。 由模块执行的去镶嵌可以是相对简单的去马赛克，例如在3×3像素块上工作的去马赛克功能。 模块的前端可以以每个时钟两个像素（ppc）接收和处理传感器数据; 水平滤波器组件将传感器数据减少到输入重定标模块的下游组件和ISP管线的一ppc。
-
公开(公告)号：US12231787B2
公开(公告)日：2025-02-18
申请号：US18669229
申请日：2024-05-20
Applicant: Apple Inc.
Inventor： Sheng Lin , D. Amnon Silverstein , David R. Pope
Abstract: Embodiments relate to image signal processors (ISP) that include binner circuits that down-sample an input image. An input image may include a plurality of pixels. The output image of the binner circuit may include a reduced number of pixels. The binner circuit may include a plurality of different operation modes. In a bin mode, the binner circuit may blend a subset of input pixel values to generate an output pixel quad. In a skip mode, the binner circuit may select one of the input pixel values as the output pixel pixel. The selection may be performed randomly to avoid aliasing. In a luminance mode, the binner circuit may take a weighted average of a subset of pixel values having different colors. In a color value mode, the binner circuit may select one of the colors in a subset of pixel values as an output pixel value.
-
Patent Agency Ranking
公开(公告)号：US20230230199A1
公开(公告)日：2023-07-20
申请号：US17578127
申请日：2022-01-18
Applicant: Apple Inc.
Inventor： Sarvesh Swami , David R. Pope , Sheng Lin , Amnon D. Silverstein
CPC classification number: G06T3/4015 , G06T3/4007 , G06T5/20
Abstract: Embodiments relate to a multi-mode demosaicing circuit able to receive and demosaic image data in a different raw image formats, such as Bayer raw image format and Quad Bayer raw image format. The multi-mode demosaicing circuit demosaics Quad Bayer image data by interpolating a green channel of the image data along each of a plurality of directions, generating a gradient of the image data along each of the plurality of directions, modifying the interpolated green channels based on respective gradients to generate full-resolution green channel image data, which is combined with red and blue image data to generate the demosaiced image data. Interpolation is performed for non-green pixels based on neighboring green pixels along a specified direction, modified by a residual value based upon values of one or more nearby same-color pixels and a correlation between values of the same-color pixels and neighboring green pixels.
-
公开(公告)号：US11442266B1
公开(公告)日：2022-09-13
申请号：US16906473
申请日：2020-06-19
Applicant: Apple Inc.
Inventor： Zahra Sadeghipoor Kermani , Sheng Lin , Emmanuel Piuze Phaneuf , Ryan Joseph Dunn , Joachim Michael Deguara , Farhan A. Baqai
Abstract: In one implementation, a method includes obtaining an image. The method includes splitting the image to produce a high-frequency component image and a low-frequency component image. The method includes downsampling the low-frequency component image to generate a downsampled low-frequency component image. The method includes correcting color aberration of the downsampled low-frequency component image to generate a color-corrected downsampled low-frequency component image. The method includes upsampling the color-corrected downsampled low-frequency component image to generate a color-corrected low-frequency component image. The method includes combining the color-corrected low-frequency component image and the high-frequency component image to generate a color-corrected version of the image.
-
公开(公告)号：US20220215506A1
公开(公告)日：2022-07-07
申请号：US17143995
申请日：2021-01-07
Applicant: Apple Inc.
Inventor： Chihsin Wu , David R. Pope , Sheng Lin , Amnon D. Silverstein
Abstract: A foveated down sampling and correction (FDS-C) circuit for combined down sampling and correction of chromatic aberrations in images. The FDS-C circuit performs down sampling and interpolation of pixel values of a first subset of pixels of a color in a raw image using down sampling scale factors and first interpolation coefficients to generate first corrected pixel values for pixels of the color in a first corrected version of the raw image. The FDS-C circuit further performs interpolation of pixel values of a second subset of the pixels in the first corrected version using second interpolation coefficients to generate second corrected pixel values for pixels of the color in a second corrected version of the raw image. Pixels in the first subset are arranged in a first direction, pixels in the second subset are arranged in a second direction, and the down sampling scale factors vary along the first direction.
-
公开(公告)号：US11375140B2
公开(公告)日：2022-06-28
申请号：US17334409
申请日：2021-05-28
Applicant: Apple Inc.
Inventor： Sheng Lin , D. Amnon Silverstein
Abstract: Embodiments relate to image signal processors (ISP) that include binner circuits that down-sample an input image. An input image may include a plurality of pixels. The output image of the binner circuit may include a reduced number of pixels. The binner circuit may include a plurality of different operation modes. In a bin mode, the binner circuit may blend a subset of input pixel values to generate an output pixel quad. In a skip mode, the binner circuit may select one of the input pixel values as the output pixel pixel. The selection may be performed randomly to avoid aliasing. In a luminance mode, the binner circuit may take a weighted average of a subset of pixel values having different colors. In a color value mode, the binner circuit may select one of the colors in a subset of pixel values as an output pixel value.
-
公开(公告)号：US20220036520A1
公开(公告)日：2022-02-03
申请号：US17500386
申请日：2021-10-13
Applicant: Apple Inc.
Inventor： Sheng Lin
Abstract: Embodiments relate to axial chromatic aberration (ACA) reduction of raw image data generated by image sensors. A chromatic aberration reduction circuit performs chromatic aberration reduction on the raw image data to correct the ACA in the full color images through sharpening that has been clamped to reduce sharpening overshoot.
-
-
-
-
-
-
-
-
-
Search Results
71
records
(took 0.021 seconds)
