公开(公告)号：US07199838B2

公开(公告)日：2007-04-03

申请号：US10871729

申请日：2004-06-17

Applicant: Peng Lin ,  Yeong-Taeg Kim

Inventor： Peng Lin ,  Yeong-Taeg Kim

IPC: H04N5/21

CPC classification number: H04N5/144 ,  G06T5/002 ,  G06T5/20 ,  G06T5/50 ,  G06T2207/10016 ,  G06T2207/20182 ,  G06T2207/20192 ,  G06T2207/20216 ,  H04N5/21

Abstract: A video noise reduction system for a set of video frames that computes a first motion signal using a current frame and multiple consecutive previous frames, computes a second motion signal using the current frame and the processed preceding frame; computes the multi-frame temporal average of the current frame and multiple consecutive previous frames; computes the recursive average of the current frame and the processed preceding frame; generates a temporal filtered signal by soft switching between the multi-frame temporal average and the recursive average based on the first motion signal; applies a spatial filter to the current frame to generate a spatial filtered signal; and combines the temporal filtered signal and the spatial filtered signal based on the second motion signal to generate a final noise reduced video output signal.

Abstract translation: 一种用于使用当前帧和多个连续先前帧计算第一运动信号的一组视频帧的视频噪声降低系统，使用当前帧和处理的先前帧计算第二运动信号; 计算当前帧和多个连续的先前帧的多帧时间平均值; 计算当前帧和处理的前一帧的递归平均值; 通过基于第一运动信号的多帧时间平均和递归平均之间的软切换来产生时间滤波信号; 对当前帧应用空间滤波器以产生空间滤波信号; 并且基于所述第二运动信号组合所述时间滤波信号和所述空间滤波信号以生成最终降噪视频输出信号。

公开(公告)号：US20050094889A1

公开(公告)日：2005-05-05

申请号：US10697362

申请日：2003-10-30

Applicant: Peng Lin ,  Yeong-Taeg Kim

Inventor： Peng Lin ,  Yeong-Taeg Kim

IPC: H04N5/21 ,  G06K9/40 ,  G06T5/00

CPC classification number: G06T5/002 ,  G06T5/20 ,  G06T2207/10016 ,  G06T2207/20008 ,  G06T2207/20012 ,  G06T2207/20192

Abstract: A global and local statistics controlled noise reduction system in which the video image noise reduction processing is effectively adaptive to both image local structure and global noise level. A noise estimation method provides reliable global noise statistics to the noise reduction system. The noise reduction system dynamically/adaptively configures a local filter for processing each image pixel, and processes the pixel with that local filter. The filtering process of the noise reduction system is controlled by both global and local image statistics that are also computed by the system.

Abstract translation: 一种全局和局部统计控制噪声降低系统，其中视频图像降噪处理有效地适应图像局部结构和全局噪声水平。 噪声估计方法为噪声降低系统提供可靠的全局噪声统计。 降噪系统动态/自适应地配置本地滤波器以处理每个图像像素，并且使用该局部滤波器处理该像素。 降噪系统的滤波过程由系统计算的全局和局部图像统计控制。

公开(公告)号：US08346008B2

公开(公告)日：2013-01-01

申请号：US12480970

申请日：2009-06-09

Applicant: Peng Lin

Inventor： Peng Lin

IPC: G06K9/40 ,  H04N5/217

CPC classification number: H04N5/35536 ,  H04N5/35509 ,  H04N5/357

Abstract: This is generally directed to systems and methods for noise reduction in high dynamic range (“HDR”) imaging systems. In some embodiments, multiple images of the same scene can be captured, where each of the images is exposed for a different amount of time. An HDR image may be created by suitably combining the images. However, the signal-to-noise ratio (“SNR”) curve of the resulting HDR image can have discontinuities in sections of the SNR curve corresponding to shifts between different exposure times. Accordingly, in some embodiments, a noise model for the HDR image can be created that takes into account these discontinuities in the SNR curve. For example, a noise model can be created that smoothes the discontinuities of the SNR curve into a continuous function. This noise model may then be used with a Bayer Filter or any other suitable noise filter to remove noise from the HDR image.

Abstract translation: 这通常涉及用于高动态范围（HDR）成像系统中降噪的系统和方法。 在一些实施例中，可以捕获相同场景的多个图像，其中每个图像被曝光不同的时间量。 可以通过适当地组合图像来创建HDR图像。 然而，所得HDR图像的信噪比（SNR）曲线可以在对应于不同曝光时间之间的移动的SNR曲线的部分中具有不连续性。 因此，在一些实施例中，可以创建考虑SNR曲线中的这些不连续性的用于HDR图像的噪声模型。 例如，可以创建将SNR曲线的不连续性平滑成连续函数的噪声模型。 然后可以将该噪声模型与拜耳滤波器或任何其它合适的噪声滤波器一起使用以从HDR图像中去除噪声。

公开(公告)号：US20100201850A1

公开(公告)日：2010-08-12

申请号：US12366865

申请日：2009-02-06

Applicant: Peng Lin

Inventor： Peng Lin

IPC: H04N9/64 ,  H04N5/335

CPC classification number: H04N5/357 ,  G06T3/4015 ,  H04N5/367 ,  H04N9/045 ,  H04N2209/046

Abstract: Embodiments describe noise reduction methods and systems for imaging devices having a pixel array having a plurality of pixels, each pixel representing one of a plurality of captured colors and having an associated captured color pixel value. Noise reduction methods filter a captured color pixel value for a respective pixel based on the captured color pixel values associated with pixels in a window of pixels surrounding the respective pixel. Disclosed embodiments provide a low cost noise reduction filtering process that takes advantage of the correlations among the red, green and blue color channels to efficiently remove noise while retaining image sharpness. A noise model can be used to derive a parameter of the noise reduction methods.

Abstract translation: 实施例描述了用于成像装置的噪声降低方法和系统，其具有具有多个像素的像素阵列，每个像素表示多个捕获的颜色之一并具有相关联的捕获的彩色像素值。 降噪方法基于与围绕相应像素的像素的窗口中的像素相关联的捕获的彩色像素值，来过滤针对相应像素的捕获的彩色像素值。 公开的实施例提供了低成本噪声降低滤波处理，其利用红色，绿色和蓝色色彩通道之间的相关性来有效地消除噪声，同时保持图像清晰度。 可以使用噪声模型来导出降噪方法的参数。

公开(公告)号：US20100013919A1

公开(公告)日：2010-01-21

申请号：US12173327

申请日：2008-07-15

Applicant: Peng Lin ,  Todd Sachs

Inventor： Peng Lin ,  Todd Sachs

IPC: H04N7/18

CPC classification number: H04N5/144 ,  G06T7/254 ,  G06T2200/28 ,  G06T2207/10016 ,  G06T2207/20068 ,  G06T2207/30232 ,  H04N5/23248

Abstract: A non-frame-based motion detection method and apparatus for imagers requires only a few line buffers and little computation. The non-frame-based, low cost motion detection method and apparatus are well suited for “system-a-chip” (SOC) imager implementations.

Abstract translation: 用于成像器的非基于帧的运动检测方法和装置仅需要几行线缓冲器和很少的计算。 基于非帧的低成本运动检测方法和装置非常适合于“系统芯片”（SOC）成像器实现。

公开(公告)号：US20090278945A1

公开(公告)日：2009-11-12

申请号：US12149723

申请日：2008-05-07

Applicant: Peng Lin

Inventor： Peng Lin

IPC: H04N5/228

CPC classification number: H04N5/23248 ,  H04N5/23267

Abstract: A method and apparatus for image stabilization while mitigating the amplification of image noise by using a motion adaptive system employing spatial and temporal filtering of pixel signals from multiple captured frames of a scene.

Abstract translation: 一种用于图像稳定的方法和装置，同时通过使用对来自场景的多个拍摄帧的像素信号进行空间和时间滤波的运动自适应系统来减轻图像噪声的放大。

公开(公告)号：US20080002902A1

公开(公告)日：2008-01-03

申请号：US11853655

申请日：2007-09-11

Applicant: Peng Lin ,  Yeong-Taeg Kim

Inventor： Peng Lin ,  Yeong-Taeg Kim

IPC: G06K9/40

CPC classification number: G06T5/002 ,  G06T5/20 ,  G06T2207/10016 ,  G06T2207/20008 ,  G06T2207/20012 ,  G06T2207/20192

Abstract: A global and local statistics controlled noise reduction system in which the video image noise reduction processing is effectively adaptive to both image local structure and global noise level. A noise estimation method provides reliable global noise statistics to the noise reduction system. The noise reduction system dynamically/adaptively configures a local filter for processing each image pixel, and processes the pixel with that local filter. The filtering process of the noise reduction system is controlled by both global and local image statistics that are also computed by the system.

Abstract translation: 一种全局和局部统计控制噪声降低系统，其中视频图像降噪处理有效地适应图像局部结构和全局噪声水平。 噪声估计方法为噪声降低系统提供可靠的全局噪声统计。 降噪系统动态/自适应地配置本地滤波器以处理每个图像像素，并且使用该局部滤波器处理该像素。 降噪系统的滤波过程由系统计算的全局和局部图像统计控制。

公开(公告)号：US20060044475A1

公开(公告)日：2006-03-02

申请号：US10934025

申请日：2004-09-02

Applicant: Peng Lin ,  Yeong-Taeg Kim

Inventor： Peng Lin ,  Yeong-Taeg Kim

IPC: H04N5/21

CPC classification number: H04N5/21 ,  Y10S348/91

Abstract: A video noise reduction system for reducing video noise in a sequence of video frames. In the video noise reduction system, a temporal filter computes multiple temporal average values for the video frames in different temporal directions. A motion detector computes multiple motion signal values for the video frames in different temporal directions. Finally, a control unit selects one of the temporal average values based on the motion signal values as output.

Abstract translation: 一种用于降低视频帧序列中的视频噪声的视频降噪系统。 在视频噪声降低系统中，时间滤波器在不同的时间方向上计算视频帧的多个时间平均值。 运动检测器在不同的时间方向上计算视频帧的多个运动信号值。 最后，控制单元基于运动信号值作为输出来选择时间平均值之一。

公开(公告)号：US20050280739A1

公开(公告)日：2005-12-22

申请号：US10871729

申请日：2004-06-17

Applicant: Peng Lin ,  Yeong-Taeg Kim

Inventor： Peng Lin ,  Yeong-Taeg Kim

IPC: G06T5/00 ,  H04N5/14 ,  H04N5/21

CPC classification number: H04N5/144 ,  G06T5/002 ,  G06T5/20 ,  G06T5/50 ,  G06T2207/10016 ,  G06T2207/20182 ,  G06T2207/20192 ,  G06T2207/20216 ,  H04N5/21

Abstract: A video noise reduction system for a set of video frames that computes a first motion signal using a current frame and multiple consecutive previous frames, computes a second motion signal using the current frame and the processed preceding frame; computes the multi-frame temporal average of the current frame and multiple consecutive previous frames; computes the recursive average of the current frame and the processed preceding frame; generates a temporal filtered signal by soft switching between the multi-frame temporal average and the recursive average based on the first motion signal; applies a spatial filter to the current frame to generate a spatial filtered signal; and combines the temporal filtered signal and the spatial filtered signal based on the second motion signal to generate a final noise reduced video output signal.

Abstract translation: 一种用于使用当前帧和多个连续先前帧计算第一运动信号的一组视频帧的视频噪声降低系统，使用当前帧和处理的先前帧计算第二运动信号; 计算当前帧和多个连续的先前帧的多帧时间平均值; 计算当前帧和处理的前一帧的递归平均值; 通过基于第一运动信号的多帧时间平均和递归平均之间的软切换来产生时间滤波信号; 对当前帧应用空间滤波器以产生空间滤波信号; 并且基于所述第二运动信号组合所述时间滤波信号和所述空间滤波信号以生成最终降噪视频输出信号。

公开(公告)号：US11019277B2

公开(公告)日：2021-05-25

申请号：US16543760

申请日：2019-08-19

Applicant: Liangtao Jiang ,  Peng Lin

Inventor： Liangtao Jiang ,  Peng Lin

IPC: H04N5/235

Abstract: A system for capturing a high dynamic range (HDR) image comprises an image sensor comprising a split pixel including a first pixel having higher effective gain and a second pixel having lower effective gain. The second pixels exposed with a capture window capture at least a pulse emitted by a light emitting diode (LED) controlled by a pulse width modulation. A first HDR image is produced by a combination including an image produced by the second pixels, and images produced by multiple exposures of the first pixels. A weight map of LED flicker correction is generated from the difference of the image produced by second pixels and the images produced by the first pixels, and the flicker areas in the first HDR image are corrected with the weight map and the image from the second pixels.