公开(公告)号：US10440299B2

公开(公告)日：2019-10-08

申请号：US14845659

申请日：2015-09-04

Applicant: Apple Inc.

Inventor： Sheng Lin ,  D. Amnon Silverstein ,  David R. Pope ,  Suk Hwan Lim

IPC: H04N5/367 ,  H04N5/217 ,  H04N1/409 ,  G06T5/00

Abstract: An image signal processor may include a pixel defect correction component that tracks defect history for frames captured by an image sensor and applies the history when identifying and correcting defective pixels in a frame. The component maintains a defect pixel location table that includes a defect confidence value for pixels of the image sensor. The component identifies defective pixels in a frame, for example by comparing each pixel's value to the values of its neighbor pixels. If a pixel is detected as defective, its defect confidence value may be incremented. Otherwise, the value may be decremented. If a pixel's defect confidence value is over a defect confidence threshold, the pixel is considered defective and thus may be corrected. If a pixel's defect confidence value is under the threshold, the pixel is considered not defective and thus may not be corrected even if the pixel was detected as defective.

公开(公告)号：US10262401B2

公开(公告)日：2019-04-16

申请号：US15499659

申请日：2017-04-27

Applicant: Apple Inc.

Inventor： Maxim W. Smirnov ,  D. Amnon Silverstein

IPC: G06T5/00 ,  G06T5/10 ,  G06T7/00

Abstract: Embodiments of the present disclosure relate to performing noise reduction on an input image by first filtering the input image based on coarse noise models of pixels and then subsequently filtering the filtered input image based on finer noise models. The finer noise models use the same or more number of neighboring pixels than the coarse noise filters. The first filtering and subsequent filtering of a pixel in the input image use Mahalanobis distances between the pixel and its neighboring pixels. By performing iterations of filtering using more refined noise models, the noise reduction in the input image can be performed more efficiently and effectively.

公开(公告)号：US20180324357A1

公开(公告)日：2018-11-08

申请号：US16019906

申请日：2018-06-27

Applicant: Apple Inc.

Inventor： D. Amnon Silverstein ,  Shun Wai Go ,  Suk Hwan Lim ,  Timothy J. Millet ,  Ting Chen ,  Bin Ni

IPC: H04N5/232 ,  H04N9/87 ,  H04N7/01 ,  H04N1/21

CPC classification number: H04N5/23245 ,  H04N1/212 ,  H04N5/23216 ,  H04N5/23232 ,  H04N5/23293 ,  H04N7/0122 ,  H04N9/87

Abstract: In an embodiment, an electronic device may be configured to capture still frames during video capture but may capture the still frames in the 4×3 aspect ratio and at higher resolution than the 16×9 aspect ratio video frames. The device may interleave high resolution, 4×3 frames and lower resolution 16×9 frames in the video sequence, and may capture the nearest higher resolution, 4×3 frame when the user indicates the capture of a still frame. Alternatively, the device may display 16×9 frames in the video sequence, and then expand to 4×3 frames when a shutter button is pressed. The device may capture the still frame and return to the 16×9 video frames responsive to a release of the shutter button.

公开(公告)号：US10043484B2

公开(公告)日：2018-08-07

申请号：US15275225

申请日：2016-09-23

Applicant: Apple Inc.

Inventor： D. Amnon Silverstein ,  Xuemei Zhang ,  Yingjun Bai ,  Brandon J. Corey ,  Yonghui Zhao

IPC: G09G5/06

Abstract: Displaying wide-gamut images as intended on color-managed wide-gamut display systems while rendering a visually consistent image when rendered on targeted narrow-gamut display systems (regardless of whether the narrow-gamut displays are color-managed). Images represented in accordance with this disclosure are referred to as a dual-target images (DTI): one target being the image's original wide-gamut color space, the other target being a specified narrow-gamut color space. The novel representational scheme retains narrow-gamut rendering for those colors in a wide-gamut image that are within the targeted narrow-gamut color space, transitioning to wide-gamut rendering for those colors in the wide-gamut image that are outside the targeted narrow-gamut color space. This approach minimizes pixel clipping when rendering a wide-gamut image for a narrow-gamut display, while allowing the original wide-gamut pixel values to be recovered when rendering for a wide-gamut display.

公开(公告)号：US20170134655A1

公开(公告)日：2017-05-11

申请号：US15414866

申请日：2017-01-25

Applicant: Apple Inc.

Inventor： D. Amnon Silverstein ,  Shun Wai Go ,  Suk Hwan Lim ,  Timothy J. Millet ,  Ting Chen ,  Bin Ni

IPC: H04N5/232

CPC classification number: H04N5/23245 ,  H04N1/212 ,  H04N5/23216 ,  H04N5/23232 ,  H04N5/23293 ,  H04N7/0122 ,  H04N9/87

Abstract: In an embodiment, an electronic device may be configured to capture still frames during video capture, but may capture the still frames in the 4×3 aspect ratio and at higher resolution than the 16×9 aspect ratio video frames. The device may interleave high resolution, 4×3 frames and lower resolution 16×9 frames in the video sequence, and may capture the nearest higher resolution, 4×3 frame when the user indicates the capture of a still frame. Alternatively, the device may display 16×9 frames in the video sequence, and then expand to 4×3 frames when a shutter button is pressed. The device may capture the still frame and return to the 16×9 video frames responsive to a release of the shutter button.

公开(公告)号：US20170098428A1

公开(公告)日：2017-04-06

申请号：US15275225

申请日：2016-09-23

Applicant: Apple Inc.

Inventor： D. Amnon Silverstein ,  Xuemei Zhang ,  Yingjun Bai ,  Brandon J. Corey ,  Yonghui Zhao

IPC: G09G5/06 ,  G06F3/00

CPC classification number: G09G5/06 ,  G09G2320/0666 ,  G09G2340/06

Abstract: In general, techniques are disclosed for displaying wide-gamut images as intended on color-managed wide-gamut display systems while rendering a visually consistent image when rendered on targeted narrow-gamut display systems (regardless of whether the narrow-gamut displays are color-managed). For this reason, an image represented in accordance with this disclosure is referred to as a dual-target image (DTI): one target being the image's original wide-gamut color space, the other target being a specified narrow-gamut color space. The novel representational scheme described herein retains narrow-gamut rendering for those colors in a wide-gamut image that are within the targeted narrow-gamut color space, transitioning to wide-gamut rendering for those colors in the wide-gamut image that are outside the targeted narrow-gamut color space. This approach minimizes pixel clipping when rendering a wide-gamut image for a narrow-gamut display, while allowing the original wide-gamut pixel values to be recovered when rendering for a wide-gamut display.

公开(公告)号：US20170061576A1

公开(公告)日：2017-03-02

申请号：US14841400

申请日：2015-08-31

Applicant: Apple Inc.

Inventor： Suk Hwan Lim ,  D. Amnon Silverstein

IPC: G06T3/40 ,  G06T5/00 ,  G06K9/46 ,  H04N5/232 ,  G06T7/40 ,  G06T1/20

CPC classification number: G06T3/40 ,  H04N5/213 ,  H04N7/0117 ,  H04N9/70

Abstract: An image processing pipeline may apply chroma suppression to image data at a scaler implemented in the image processing pipeline. Image data collected for an image may be received at a scaler that is encoded in a color space that includes a luminance component and chrominance components. When resampling the image data to generate a different size of the image, the scaler may attenuate the chrominance components of the image data according to the luminance component of the image data. The scaler may also perform dot error correction and convert the image data from one subsampling scheme to another.

Abstract translation: 图像处理流水线可以对图像处理流水线中实现的缩放器的图像数据应用色度抑制。 针对图像收集的图像数据可以在编码在包括亮度分量和色度分量的颜色空间中的缩放器处被接收。 当重新采样图像数据以产生图像的不同大小时，缩放器可以根据图像数据的亮度分量来衰减图像数据的色度分量。 缩放器还可以执行点错误校正，并将图像数据从一个子采样方案转换到另一个子采样方案。

公开(公告)号：US09413951B2

公开(公告)日：2016-08-09

申请号：US14449016

申请日：2014-07-31

Applicant: Apple Inc.

Inventor： Suk Hwan Lim ,  D. Amnon Silverstein ,  Sheng Lin

IPC: H04N5/232 ,  G06T5/10

CPC classification number: H04N5/23229 ,  G06T5/002 ,  G06T5/10 ,  G06T7/20 ,  G06T2207/20182 ,  G06T2207/20201 ,  H04N5/23254 ,  H04N5/23267 ,  H04N9/045

Abstract: A temporal filter may perform dynamic motion estimation and compensation for filtering an image frame. A row of pixels in an image frame received for processing at the temporal filter may be received. A motion estimate may be dynamically determined that registers a previously filtered reference image frame with respect to the row of pixels in the image frame. The reference image frame may be aligned according to the determined motion estimate, and pixels in the row of the image frame may be blended with corresponding pixels in the aligned reference image frame to generate a filtered version of the image frame. Motion statistics may be collected for subsequent processing based on the motion estimation and alignment for the row of pixels in the image frame.

Abstract translation: 时间滤波器可以执行用于过滤图像帧的动态运动估计和补偿。 可以接收用于在时间滤波器处理的图像帧中的像素行。 可以动态地确定运动估计，其相对于图像帧中的像素行注册先前滤波的参考图像帧。 可以根据确定的运动估计来对准参考图像帧，并且可以将图像帧的行中的像素与对准的参考图像帧中的对应像素混合以生成图像帧的滤波版本。 可以基于图像帧中的像素行的运动估计和对准来收集运动统计信息用于后续处理。

公开(公告)号：US20150348246A1

公开(公告)日：2015-12-03

申请号：US14822316

申请日：2015-08-10

Applicant: APPLE INC.

Inventor： Suk Hwan Lim ,  D. Amnon Silverstein ,  Guy Cote ,  Steven David Hordley ,  Graham Finlayson ,  Weichun Ku ,  Joseph P. Bratt

IPC: G06T5/00 ,  G06T1/20 ,  G06K9/38 ,  G06T5/50

CPC classification number: G06T5/001 ,  G06K9/38 ,  G06T1/20 ,  G06T5/002 ,  G06T5/003 ,  G06T5/008 ,  G06T5/50 ,  G06T2207/10024 ,  G06T2207/20012 ,  G06T2207/20028 ,  G06T2207/20208

Abstract: Systems and methods for local tone mapping are provided. In one example, an electronic device includes an electronic display, an imaging device, and an image signal processor. The electronic display may display images of a first bit depth, and the imaging device may include an image sensor that obtains image data of a higher bit depth than the first bit depth. The image signal processor may process the image data, and may include local tone mapping logic that may apply a spatially varying local tone curve to a pixel of the image data to preserve local contrast when displayed on the display. The local tone mapping logic may smooth the local tone curve applied to the intensity difference between the pixel and another nearby pixel exceeds a threshold.

Abstract translation: 提供了本地色调映射的系统和方法。 在一个示例中，电子设备包括电子显示器，成像设备和图像信号处理器。 电子显示器可以显示第一位深度的图像，并且成像装置可以包括获得比第一位深度更高的位深度的图像数据的图像传感器。 图像信号处理器可以处理图像数据，并且可以包括本地色调映射逻辑，其可以将空间上变化的本地色调曲线应用于图像数据的像素，以便在显示器上显示时保持局部对比度。 本地色调映射逻辑可以平滑应用于像素和另一附近像素之间的强度差超过阈值的局部色调曲线。

公开(公告)号：US09113118B2

公开(公告)日：2015-08-18

申请号：US13889937

申请日：2013-05-08

Applicant: APPLE INC.

Inventor： D. Amnon Silverstein ,  Suk Hwan Lim ,  Sheng Lin ,  Guy Côté

IPC: G06K9/00 ,  H04N9/73 ,  H04N5/14 ,  H04N9/04

CPC classification number: H04N9/73 ,  H04N5/142 ,  H04N9/045 ,  H04N9/735 ,  H04N2209/046

Abstract: Systems and methods for correcting green channel non-uniformity (GNU) are provided. In one example, GNU may be corrected using energies between the two green channels (Gb and Gr) during green interpolation processes for red and green pixels. Accordingly, the processes may be efficiently employed through implementation using demosaic logic hardware. In addition, the green values may be corrected based on low-pass-filtered values of the green pixels (Gb and Gr). Additionally, green post-processing may provide some defective pixel correction on interpolated greens by correcting artifacts generated through enhancement algorithms.

Abstract translation: 提供了校正绿色通道不均匀性（GNU）的系统和方法。 在一个示例中，可以在用于红色和绿色像素的绿色插值处理期间使用两个绿色通道（Gb和Gr）之间的能量来校正GNU。 因此，可以通过使用去马赛克逻辑硬件的实现来有效地采用该过程。 此外，绿色值可以基于绿色像素的低通滤波值（Gb和Gr）来校正。 此外，绿色后处理可以通过校正通过增强算法产生的伪影来对内插果实提供一些缺陷像素校正。