公开(公告)号：US20100066849A1

公开(公告)日：2010-03-18

申请号：US12375669

申请日：2007-07-24

申请人： Suk Hwan Lim ,  D. Amnon Silverstein ,  Qian Lin

发明人： Suk Hwan Lim ,  D. Amnon Silverstein ,  Qian Lin

IPC分类号： H04N5/228

CPC分类号： H04N5/2351 ,  H04N5/343 ,  H04N5/347 ,  H04N5/351

摘要： An image processing method and device are described. The method includes the steps of capturing the contents a scene in a first pass (310), determining a binning pattern for pixels representing the scene (350) based on measured brightness values of the pixels (320) and capturing contents of the image in a second pass using the binning pattern (360).

摘要翻译： 描述图像处理方法和装置。 该方法包括以下步骤：在第一遍（310）中捕获场景的内容，基于所测量的像素的亮度值（320）和捕获图像的内容来确定表示场景（350）的像素的合并模式 使用分档模式（360）进行第二遍。

公开(公告)号：US20080024618A1

公开(公告)日：2008-01-31

申请号：US11496845

申请日：2006-07-31

申请人： Suk Hwan Lim ,  D. Amnon Silverstein ,  Qian Lin

发明人： Suk Hwan Lim ,  D. Amnon Silverstein ,  Qian Lin

IPC分类号： H04N5/228

CPC分类号： H04N5/2351 ,  H04N5/343 ,  H04N5/347 ,  H04N5/351

摘要： An image processing method and device are described. The method includes the steps of capturing the contents a scene in a first pass, determining a binning pattern for pixels representing the scene based on measured brightness values of the pixels and capturing contents of the image in a second pass using the binning pattern.

摘要翻译： 描述图像处理方法和装置。 该方法包括以下步骤：在第一遍中拍摄场景，基于所测量的像素的亮度值，使用合并模式在第二遍中捕获图像的内容，确定表示场景的像素的合并模式。

公开(公告)号：US08953882B2

公开(公告)日：2015-02-10

申请号：US13485299

申请日：2012-05-31

申请人： Suk Hwan Lim ,  D. Amnon Silverstein ,  Mark A. Zimmer ,  Guy Cote

发明人： Suk Hwan Lim ,  D. Amnon Silverstein ,  Mark A. Zimmer ,  Guy Cote

IPC分类号： G06K9/00 ,  H04N5/217

CPC分类号： G06T1/20 ,  H04N17/002

摘要： The present disclosure generally relates to systems and methods for image data processing. In certain embodiments, an image processing pipeline may compute noise statistics associated with image data by receiving a frame of the image data having a plurality of pixels. The image processing pipeline may then identify a plurality of portions of the frame of the image data such that each portion of the plurality of portions has a flat surface. The image processing pipeline may then calculate a plurality of gradients for each portion of the plurality of portions, determine one or more dominant gradient orientations for each portion of the plurality of portions, and generate a histogram that represents a plurality of dominant gradient orientations that corresponds to the plurality of portions. After generating the histogram, the image processing pipeline may store the histogram, which may represent the noise statistics, in a memory.

摘要翻译： 本公开通常涉及用于图像数据处理的系统和方法。 在某些实施例中，图像处理流水线可以通过接收具有多个像素的图像数据的帧来计算与图像数据相关联的噪声统计。 然后，图像处理流水线可以识别图像数据的帧的多个部分，使得多个部分的每个部分具有平坦表面。 然后，图像处理流水线可以为多个部分的每个部分计算多个梯度，为多个部分的每个部分确定一个或多个主要梯度取向，并且生成表示对应于多个部分的多个主要梯度取向的直方图 到多个部分。 在生成直方图之后，图像处理流水线可以将可以表示噪声统计的直方图存储在存储器中。

公开(公告)号：US20130321679A1

公开(公告)日：2013-12-05

申请号：US13485199

申请日：2012-05-31

申请人： Suk Hwan Lim ,  David Hayward ,  D. Amnon Silverstein

发明人： Suk Hwan Lim ,  David Hayward ,  D. Amnon Silverstein

IPC分类号： H04N9/68

CPC分类号： H04N5/23229 ,  H04N5/2355 ,  H04N9/045 ,  H04N2209/046

摘要： Image sensors have finite ranges of illuminance that may be captured. When the sensors for particular pixels receive an amount of light exceeding these finite ranges, the pixel values clip to the maximum pixel value. Systems and methods for estimating pixel values that are clipped or near clipping are provided. In one example, a method for processing image data includes determining that a first channel of the image data is saturated or near saturation. The method further includes computing a highlight recovery value for the first channel based upon alternative channels in the image data that are not saturated or near saturation. The highlight recovery value is applied to the first channel.

摘要翻译： 图像传感器有可能被捕获的有限的照度范围。 当特定像素的传感器接收到超过这些有限范围的光量时，像素值将剪切到最大像素值。 提供了用于估计被裁剪或接近裁剪的像素值的系统和方法。 在一个示例中，用于处理图像数据的方法包括确定图像数据的第一通道饱和或接近饱和。 该方法还包括基于不饱和或接近饱和的图像数据中的替代信道来计算第一信道的高亮恢复值。 高亮恢复值应用于第一个通道。

公开(公告)号：US20130321678A1

公开(公告)日：2013-12-05

申请号：US13485235

申请日：2012-05-31

申请人： Guy Cote ,  Joseph Anthony Petolino, JR. ,  Suk Hwan Lim ,  D. Amnon Silverstein

发明人： Guy Cote ,  Joseph Anthony Petolino, JR. ,  Suk Hwan Lim ,  D. Amnon Silverstein

IPC分类号： H04N9/64 ,  G06K9/00

CPC分类号： H04N9/64 ,  H04N5/142 ,  H04N5/23229 ,  H04N5/23254 ,  H04N5/365 ,  H04N5/367 ,  H04N9/045 ,  H04N9/735

摘要： Systems and methods for correcting intensity drop-offs due to geometric properties of lenses are provided. In one example, a method includes receiving an input pixel of the image data, the image data acquired using an image sensor. A color component of the input pixel is determined. A gain grid is determined by pointing to the gain grid in external memory. Each of the plurality of grid points is associated with a lens shading gain selected based upon the color of the input pixel. A nearest set of grid points that enclose the input pixel is identified. Further, a lens shading gain is determined by interpolating the lens shading gains associated with each of the set of grid points and is applied to the input pixel.

摘要翻译： 提供了由于透镜的几何特性来校正强度降低的系统和方法。 在一个示例中，一种方法包括接收图像数据的输入像素，使用图像传感器获取的图像数据。 确定输入像素的颜色分量。 通过指向外部存储器中的增益栅格来确定增益栅格。 多个网格点中的每一个都与基于输入像素的颜色选择的透镜阴影增益相关联。 识别包围输入像素的最近的一组网格点。 此外，通过内插与该组网格点中的每一个相关联的透镜遮蔽增益来确定透镜阴影增益，并将其应用于输入像素。

公开(公告)号：US20130321671A1

公开(公告)日：2013-12-05

申请号：US13485101

申请日：2012-05-31

申请人： Guy Cote ,  D. Amnon Silverstein ,  Suk Hwan Lim ,  Sheng Lin ,  Haitao Guo

发明人： Guy Cote ,  D. Amnon Silverstein ,  Suk Hwan Lim ,  Sheng Lin ,  Haitao Guo

IPC分类号： H04N5/217

CPC分类号： H04N5/365

摘要： The present disclosure generally relates to systems and methods for image data processing. In certain embodiments, an image processing pipeline may be configured to receive a frame of the image data having a plurality of pixels acquired using a digital image sensor. The image processing pipeline may then be configured to determine a first plurality of correction factors that may correct each pixel in the plurality of pixels for fixed pattern noise. The first plurality of correction factors may be determined based at least in part on fixed pattern noise statistics that correspond to the frame of the image data. After determining the first plurality of correction factors, the image processing pipeline may be configured to configured to apply the first plurality of correction factors to the plurality of pixels, thereby reducing the fixed pattern noise present in the plurality of pixels.

摘要翻译： 本公开通常涉及用于图像数据处理的系统和方法。 在某些实施例中，图像处理流水线可以被配置为接收具有使用数字图像传感器获取的多个像素的图像数据的帧。 然后，图像处理流水线可以被配置为确定可修正多个像素中的每个像素以用于固定模式噪声的第一多个校正因子。 可以至少部分地基于对应于图像数据的帧的固定模式噪声统计来确定第一多个校正因子。 在确定了第一多个校正因子之后，图像处理流水线可以被配置为将多个第一校正因子应用于多个像素，从而减少存在于多个像素中的固定模式噪声。

公开(公告)号：US11089247B2

公开(公告)日：2021-08-10

申请号：US13485101

申请日：2012-05-31

申请人： Guy Cote ,  D. Amnon Silverstein ,  Suk Hwan Lim ,  Sheng Lin ,  Haitao Guo

发明人： Guy Cote ,  D. Amnon Silverstein ,  Suk Hwan Lim ,  Sheng Lin ,  Haitao Guo

IPC分类号： H04N5/217 ,  H04N5/365

摘要： The present disclosure generally relates to systems and methods for image data processing. In certain embodiments, an image processing pipeline may be configured to receive a frame of the image data having a plurality of pixels acquired using a digital image sensor. The image processing pipeline may then be configured to determine a first plurality of correction factors that may correct each pixel in the plurality of pixels for fixed pattern noise. The first plurality of correction factors may be determined based at least in part on fixed pattern noise statistics that correspond to the frame of the image data. After determining the first plurality of correction factors, the image processing pipeline may be configured to configured to apply the first plurality of correction factors to the plurality of pixels, thereby reducing the fixed pattern noise present in the plurality of pixels.

公开(公告)号：US08872946B2

公开(公告)日：2014-10-28

申请号：US13485056

申请日：2012-05-31

申请人： Guy Cote ,  Sheng Lin ,  Suk Hwan Lim ,  D. Amnon Silverstein ,  David Hayward ,  Simon Wolfenden Butler ,  Joseph Anthony Petolino, Jr. ,  Joseph P. Bratt

发明人： Guy Cote ,  Sheng Lin ,  Suk Hwan Lim ,  D. Amnon Silverstein ,  David Hayward ,  Simon Wolfenden Butler ,  Joseph Anthony Petolino, Jr. ,  Joseph P. Bratt

IPC分类号： H04N5/217

CPC分类号： H04N5/217 ,  H04N5/2176 ,  H04N5/357

摘要： Systems and methods for processing raw image data are provided. One example of such a system may include memory to store image data in raw format from a digital imaging device and an image signal processor to process the image data. The image signal processor may include data conversion logic and a raw image processing pipeline. The data conversion logic may convert the image data into a signed format to preserve negative noise from the digital imaging device. The raw image processing pipeline may at least partly process the image data in the signed format. The raw image processing pipeline may also include, among other things, black level compensation logic, fixed pattern noise reduction logic, temporal filtering logic, defective pixel correction logic, spatial noise filtering logic, lens shading correction logic, and highlight recovery logic.

摘要翻译： 提供了处理原始图像数据的系统和方法。 这种系统的一个示例可以包括存储器，以存储来自数字成像设备的原始格式的图像数据和图像信号处理器来处理图像数据。 图像信号处理器可以包括数据转换逻辑和原始图像处理流水线。 数据转换逻辑可以将图像数据转换为带符号格式以保护来自数字成像装置的负噪声。 原始图像处理流水线可以至少部分地以签名格式处理图像数据。 原始图像处理流水线还可以包括黑电平补偿逻辑，固定图案噪声降低逻辑，时间滤波逻辑，缺陷像素校正逻辑，空间噪声滤波逻辑，透镜阴影校正逻辑和高亮恢复逻辑。

公开(公告)号：US20130322753A1

公开(公告)日：2013-12-05

申请号：US13485421

申请日：2012-05-31

申请人： Suk Hwan Lim ,  D. Amnon Silverstein ,  Guy Cote ,  Steven David Hordley ,  Graham Finlayson ,  Weichun Ku ,  Joseph P. Bratt

发明人： Suk Hwan Lim ,  D. Amnon Silverstein ,  Guy Cote ,  Steven David Hordley ,  Graham Finlayson ,  Weichun Ku ,  Joseph P. Bratt

IPC分类号： G06T5/00

CPC分类号： G06T5/001 ,  G06K9/38 ,  G06T1/20 ,  G06T5/002 ,  G06T5/003 ,  G06T5/008 ,  G06T5/50 ,  G06T2207/10024 ,  G06T2207/20012 ,  G06T2207/20028 ,  G06T2207/20208

摘要： Systems and methods for local tone mapping are provided. In one example, an electronic device includes an electronic display, an imaging device, and an image signal processor. The electronic display may display images of a first bit depth, and the imaging device may include an image sensor that obtains image data of a higher bit depth than the first bit depth. The image signal processor may process the image data, and may include local tone mapping logic that may apply a spatially varying local tone curve to a pixel of the image data to preserve local contrast when displayed on the display. The local tone mapping logic may smooth the local tone curve applied to the intensity difference between the pixel and another nearby pixel exceeds a threshold.

公开(公告)号：US20130321672A1

公开(公告)日：2013-12-05

申请号：US13485124

申请日：2012-05-31

申请人： D. Amnon Silverstein ,  Sheng Lin ,  Suk Hwan Lim ,  Guy Cote ,  Haitao Guo

发明人： D. Amnon Silverstein ,  Sheng Lin ,  Suk Hwan Lim ,  Guy Cote ,  Haitao Guo

IPC分类号： H04N5/228 ,  H04N5/00

CPC分类号： G06T5/005 ,  H04N5/365

摘要： The present disclosure generally relates to systems and methods for image data processing. In certain embodiments, an image processing pipeline may collect statistics associated with fixed pattern noise of image data by receiving a first frame of the image data comprising a plurality of pixels. The image processing pipeline may then determine a sum of a first plurality of pixel values that correspond to at least a first portion of the plurality of pixels such that each pixel in at least the first portion of the plurality of pixels is disposed along a first axis within the frame of the image data. After determining the sum of the first plurality of pixel values, the image processing pipeline may store the sum of the first plurality of pixel values in a memory such that the sum of the first plurality of pixel values represent the statistics.

摘要翻译： 本公开通常涉及用于图像数据处理的系统和方法。 在某些实施例中，图像处理流水线可以通过接收包括多个像素的图像数据的第一帧来收集与图像数据的固定模式噪声相关联的统计信息。 然后，图像处理流水线可以确定对应于多个像素的至少第一部分的第一多个像素值的和，使得至少第一部分中的每个像素沿着第一轴设置 在图像数据的帧内。 在确定第一多个像素值的和之后，图像处理流水线可以将第一多个像素值的和存储在存储器中，使得第一多个像素值的和代表统计。