公开(公告)号：US08953882B2

公开(公告)日：2015-02-10

申请号：US13485299

申请日：2012-05-31

申请人： Suk Hwan Lim ,  D. Amnon Silverstein ,  Mark A. Zimmer ,  Guy Cote

发明人： Suk Hwan Lim ,  D. Amnon Silverstein ,  Mark A. Zimmer ,  Guy Cote

IPC分类号： G06K9/00 ,  H04N5/217

CPC分类号： G06T1/20 ,  H04N17/002

摘要： The present disclosure generally relates to systems and methods for image data processing. In certain embodiments, an image processing pipeline may compute noise statistics associated with image data by receiving a frame of the image data having a plurality of pixels. The image processing pipeline may then identify a plurality of portions of the frame of the image data such that each portion of the plurality of portions has a flat surface. The image processing pipeline may then calculate a plurality of gradients for each portion of the plurality of portions, determine one or more dominant gradient orientations for each portion of the plurality of portions, and generate a histogram that represents a plurality of dominant gradient orientations that corresponds to the plurality of portions. After generating the histogram, the image processing pipeline may store the histogram, which may represent the noise statistics, in a memory.

摘要翻译： 本公开通常涉及用于图像数据处理的系统和方法。 在某些实施例中，图像处理流水线可以通过接收具有多个像素的图像数据的帧来计算与图像数据相关联的噪声统计。 然后，图像处理流水线可以识别图像数据的帧的多个部分，使得多个部分的每个部分具有平坦表面。 然后，图像处理流水线可以为多个部分的每个部分计算多个梯度，为多个部分的每个部分确定一个或多个主要梯度取向，并且生成表示对应于多个部分的多个主要梯度取向的直方图 到多个部分。 在生成直方图之后，图像处理流水线可以将可以表示噪声统计的直方图存储在存储器中。

公开(公告)号：US20130322746A1

公开(公告)日：2013-12-05

申请号：US13484926

申请日：2012-05-31

申请人： Guy Cote ,  Sheng Lin ,  Suk Hwan Lim ,  D. Amnon Silverstein ,  Simon Wolfenden Butler ,  Mark A. Zimmer ,  Joseph P. Bratt

发明人： Guy Cote ,  Sheng Lin ,  Suk Hwan Lim ,  D. Amnon Silverstein ,  Simon Wolfenden Butler ,  Mark A. Zimmer ,  Joseph P. Bratt

IPC分类号： G06K9/40

CPC分类号： G06T1/20 ,  G06T3/4015

摘要： Systems and methods for processing YCC image data provided. In one example, an electronic device includes memory to store image data in RGB or YCC format and a YCC image processing pipeline to process the image data. The YCC image processing pipeline may include receiving logic configured to receive the image data in RGB or YCC format and color space conversion logic configured to, when the image data is received in RGB format, convert the image data into YCC format. The YCC image processing logic may also include luma sharpening and chroma suppression logic; brightness, contrast, and color adjustment logic; gamma logic; chroma decimation logic; scaling logic; and chromanoise reduction logic.

摘要翻译： 用于处理提供的YCC图像数据的系统和方法。 在一个示例中，电子设备包括以RGB或YCC格式存储图像数据的存储器和用于处理图像数据的YCC图像处理流水线。 YCC图像处理流水线可以包括被配置为接收RGB或YCC格式的图像数据的接收逻辑，以及配置为当以RGB格式接收图像数据时将图像数据转换为YCC格式的颜色空间转换逻辑。 YCC图像处理逻辑还可以包括亮度锐化和色度抑制逻辑; 亮度，对比度和颜色调整逻辑; 伽玛逻辑; 色度抽取逻辑; 缩放逻辑; 和色度降低逻辑。

公开(公告)号：US09025867B2

公开(公告)日：2015-05-05

申请号：US13484926

申请日：2012-05-31

申请人： Guy Cote ,  Sheng Lin ,  Suk Hwan Lim ,  D. Amnon Silverstein ,  Simon Wolfenden Butler ,  Mark A. Zimmer ,  Joseph P. Bratt

发明人： Guy Cote ,  Sheng Lin ,  Suk Hwan Lim ,  D. Amnon Silverstein ,  Simon Wolfenden Butler ,  Mark A. Zimmer ,  Joseph P. Bratt

IPC分类号： G06K9/00 ,  G06T1/20 ,  G06T3/40

CPC分类号： G06T1/20 ,  G06T3/4015

摘要： Systems and methods for processing YCC image data provided. In one example, an electronic device includes memory to store image data in RGB or YCC format and a YCC image processing pipeline to process the image data. The YCC image processing pipeline may include receiving logic configured to receive the image data in RGB or YCC format and color space conversion logic configured to, when the image data is received in RGB format, convert the image data into YCC format. The YCC image processing logic may also include luma sharpening and chroma suppression logic; brightness, contrast, and color adjustment logic; gamma logic; chroma decimation logic; scaling logic; and chroma noise reduction logic.

摘要翻译： 用于处理提供的YCC图像数据的系统和方法。 在一个示例中，电子设备包括以RGB或YCC格式存储图像数据的存储器和用于处理图像数据的YCC图像处理流水线。 YCC图像处理流水线可以包括被配置为接收RGB或YCC格式的图像数据的接收逻辑，以及配置为当以RGB格式接收图像数据时将图像数据转换为YCC格式的颜色空间转换逻辑。 YCC图像处理逻辑还可以包括亮度锐化和色度抑制逻辑; 亮度，对比度和颜色调整逻辑; 伽玛逻辑; 色度抽取逻辑; 缩放逻辑; 和色度降噪逻辑。

公开(公告)号：US20130321678A1

公开(公告)日：2013-12-05

申请号：US13485235

申请日：2012-05-31

申请人： Guy Cote ,  Joseph Anthony Petolino, JR. ,  Suk Hwan Lim ,  D. Amnon Silverstein

发明人： Guy Cote ,  Joseph Anthony Petolino, JR. ,  Suk Hwan Lim ,  D. Amnon Silverstein

IPC分类号： H04N9/64 ,  G06K9/00

CPC分类号： H04N9/64 ,  H04N5/142 ,  H04N5/23229 ,  H04N5/23254 ,  H04N5/365 ,  H04N5/367 ,  H04N9/045 ,  H04N9/735

摘要： Systems and methods for correcting intensity drop-offs due to geometric properties of lenses are provided. In one example, a method includes receiving an input pixel of the image data, the image data acquired using an image sensor. A color component of the input pixel is determined. A gain grid is determined by pointing to the gain grid in external memory. Each of the plurality of grid points is associated with a lens shading gain selected based upon the color of the input pixel. A nearest set of grid points that enclose the input pixel is identified. Further, a lens shading gain is determined by interpolating the lens shading gains associated with each of the set of grid points and is applied to the input pixel.

摘要翻译： 提供了由于透镜的几何特性来校正强度降低的系统和方法。 在一个示例中，一种方法包括接收图像数据的输入像素，使用图像传感器获取的图像数据。 确定输入像素的颜色分量。 通过指向外部存储器中的增益栅格来确定增益栅格。 多个网格点中的每一个都与基于输入像素的颜色选择的透镜阴影增益相关联。 识别包围输入像素的最近的一组网格点。 此外，通过内插与该组网格点中的每一个相关联的透镜遮蔽增益来确定透镜阴影增益，并将其应用于输入像素。

公开(公告)号：US20130321671A1

公开(公告)日：2013-12-05

申请号：US13485101

申请日：2012-05-31

申请人： Guy Cote ,  D. Amnon Silverstein ,  Suk Hwan Lim ,  Sheng Lin ,  Haitao Guo

发明人： Guy Cote ,  D. Amnon Silverstein ,  Suk Hwan Lim ,  Sheng Lin ,  Haitao Guo

IPC分类号： H04N5/217

CPC分类号： H04N5/365

摘要： The present disclosure generally relates to systems and methods for image data processing. In certain embodiments, an image processing pipeline may be configured to receive a frame of the image data having a plurality of pixels acquired using a digital image sensor. The image processing pipeline may then be configured to determine a first plurality of correction factors that may correct each pixel in the plurality of pixels for fixed pattern noise. The first plurality of correction factors may be determined based at least in part on fixed pattern noise statistics that correspond to the frame of the image data. After determining the first plurality of correction factors, the image processing pipeline may be configured to configured to apply the first plurality of correction factors to the plurality of pixels, thereby reducing the fixed pattern noise present in the plurality of pixels.

摘要翻译： 本公开通常涉及用于图像数据处理的系统和方法。 在某些实施例中，图像处理流水线可以被配置为接收具有使用数字图像传感器获取的多个像素的图像数据的帧。 然后，图像处理流水线可以被配置为确定可修正多个像素中的每个像素以用于固定模式噪声的第一多个校正因子。 可以至少部分地基于对应于图像数据的帧的固定模式噪声统计来确定第一多个校正因子。 在确定了第一多个校正因子之后，图像处理流水线可以被配置为将多个第一校正因子应用于多个像素，从而减少存在于多个像素中的固定模式噪声。

公开(公告)号：US11089247B2

公开(公告)日：2021-08-10

申请号：US13485101

申请日：2012-05-31

申请人： Guy Cote ,  D. Amnon Silverstein ,  Suk Hwan Lim ,  Sheng Lin ,  Haitao Guo

发明人： Guy Cote ,  D. Amnon Silverstein ,  Suk Hwan Lim ,  Sheng Lin ,  Haitao Guo

IPC分类号： H04N5/217 ,  H04N5/365

摘要： The present disclosure generally relates to systems and methods for image data processing. In certain embodiments, an image processing pipeline may be configured to receive a frame of the image data having a plurality of pixels acquired using a digital image sensor. The image processing pipeline may then be configured to determine a first plurality of correction factors that may correct each pixel in the plurality of pixels for fixed pattern noise. The first plurality of correction factors may be determined based at least in part on fixed pattern noise statistics that correspond to the frame of the image data. After determining the first plurality of correction factors, the image processing pipeline may be configured to configured to apply the first plurality of correction factors to the plurality of pixels, thereby reducing the fixed pattern noise present in the plurality of pixels.

公开(公告)号：US08872946B2

公开(公告)日：2014-10-28

申请号：US13485056

申请日：2012-05-31

申请人： Guy Cote ,  Sheng Lin ,  Suk Hwan Lim ,  D. Amnon Silverstein ,  David Hayward ,  Simon Wolfenden Butler ,  Joseph Anthony Petolino, Jr. ,  Joseph P. Bratt

发明人： Guy Cote ,  Sheng Lin ,  Suk Hwan Lim ,  D. Amnon Silverstein ,  David Hayward ,  Simon Wolfenden Butler ,  Joseph Anthony Petolino, Jr. ,  Joseph P. Bratt

IPC分类号： H04N5/217

CPC分类号： H04N5/217 ,  H04N5/2176 ,  H04N5/357

摘要： Systems and methods for processing raw image data are provided. One example of such a system may include memory to store image data in raw format from a digital imaging device and an image signal processor to process the image data. The image signal processor may include data conversion logic and a raw image processing pipeline. The data conversion logic may convert the image data into a signed format to preserve negative noise from the digital imaging device. The raw image processing pipeline may at least partly process the image data in the signed format. The raw image processing pipeline may also include, among other things, black level compensation logic, fixed pattern noise reduction logic, temporal filtering logic, defective pixel correction logic, spatial noise filtering logic, lens shading correction logic, and highlight recovery logic.

摘要翻译： 提供了处理原始图像数据的系统和方法。 这种系统的一个示例可以包括存储器，以存储来自数字成像设备的原始格式的图像数据和图像信号处理器来处理图像数据。 图像信号处理器可以包括数据转换逻辑和原始图像处理流水线。 数据转换逻辑可以将图像数据转换为带符号格式以保护来自数字成像装置的负噪声。 原始图像处理流水线可以至少部分地以签名格式处理图像数据。 原始图像处理流水线还可以包括黑电平补偿逻辑，固定图案噪声降低逻辑，时间滤波逻辑，缺陷像素校正逻辑，空间噪声滤波逻辑，透镜阴影校正逻辑和高亮恢复逻辑。

公开(公告)号：US20130322753A1

公开(公告)日：2013-12-05

申请号：US13485421

申请日：2012-05-31

申请人： Suk Hwan Lim ,  D. Amnon Silverstein ,  Guy Cote ,  Steven David Hordley ,  Graham Finlayson ,  Weichun Ku ,  Joseph P. Bratt

发明人： Suk Hwan Lim ,  D. Amnon Silverstein ,  Guy Cote ,  Steven David Hordley ,  Graham Finlayson ,  Weichun Ku ,  Joseph P. Bratt

IPC分类号： G06T5/00

CPC分类号： G06T5/001 ,  G06K9/38 ,  G06T1/20 ,  G06T5/002 ,  G06T5/003 ,  G06T5/008 ,  G06T5/50 ,  G06T2207/10024 ,  G06T2207/20012 ,  G06T2207/20028 ,  G06T2207/20208

摘要： Systems and methods for local tone mapping are provided. In one example, an electronic device includes an electronic display, an imaging device, and an image signal processor. The electronic display may display images of a first bit depth, and the imaging device may include an image sensor that obtains image data of a higher bit depth than the first bit depth. The image signal processor may process the image data, and may include local tone mapping logic that may apply a spatially varying local tone curve to a pixel of the image data to preserve local contrast when displayed on the display. The local tone mapping logic may smooth the local tone curve applied to the intensity difference between the pixel and another nearby pixel exceeds a threshold.

公开(公告)号：US20130321672A1

公开(公告)日：2013-12-05

申请号：US13485124

申请日：2012-05-31

申请人： D. Amnon Silverstein ,  Sheng Lin ,  Suk Hwan Lim ,  Guy Cote ,  Haitao Guo

发明人： D. Amnon Silverstein ,  Sheng Lin ,  Suk Hwan Lim ,  Guy Cote ,  Haitao Guo

IPC分类号： H04N5/228 ,  H04N5/00

CPC分类号： G06T5/005 ,  H04N5/365

摘要： The present disclosure generally relates to systems and methods for image data processing. In certain embodiments, an image processing pipeline may collect statistics associated with fixed pattern noise of image data by receiving a first frame of the image data comprising a plurality of pixels. The image processing pipeline may then determine a sum of a first plurality of pixel values that correspond to at least a first portion of the plurality of pixels such that each pixel in at least the first portion of the plurality of pixels is disposed along a first axis within the frame of the image data. After determining the sum of the first plurality of pixel values, the image processing pipeline may store the sum of the first plurality of pixel values in a memory such that the sum of the first plurality of pixel values represent the statistics.

摘要翻译： 本公开通常涉及用于图像数据处理的系统和方法。 在某些实施例中，图像处理流水线可以通过接收包括多个像素的图像数据的第一帧来收集与图像数据的固定模式噪声相关联的统计信息。 然后，图像处理流水线可以确定对应于多个像素的至少第一部分的第一多个像素值的和，使得至少第一部分中的每个像素沿着第一轴设置 在图像数据的帧内。 在确定第一多个像素值的和之后，图像处理流水线可以将第一多个像素值的和存储在存储器中，使得第一多个像素值的和代表统计。

公开(公告)号：US20130321673A1

公开(公告)日：2013-12-05

申请号：US13485299

申请日：2012-05-31

申请人： Suk Hwan Lim ,  D. Amnon Silverstein ,  Mark A. Zimmer ,  Guy A. Cote

发明人： Suk Hwan Lim ,  D. Amnon Silverstein ,  Mark A. Zimmer ,  Guy A. Cote

IPC分类号： H04N5/217

CPC分类号： G06T1/20 ,  H04N17/002

摘要： The present disclosure generally relates to systems and methods for image data processing. In certain embodiments, an image processing pipeline may compute noise statistics associated with image data by receiving a frame of the image data having a plurality of pixels. The image processing pipeline may then identify a plurality of portions of the frame of the image data such that each portion of the plurality of portions has a flat surface. The image processing pipeline may then calculate a plurality of gradients for each portion of the plurality of portions, determine one or more dominant gradient orientations for each portion of the plurality of portions, and generate a histogram that represents a plurality of dominant gradient orientations that corresponds to the plurality of portions. After generating the histogram, the image processing pipeline may store the histogram, which may represent the noise statistics, in a memory.

摘要翻译： 本公开通常涉及用于图像数据处理的系统和方法。 在某些实施例中，图像处理流水线可以通过接收具有多个像素的图像数据的帧来计算与图像数据相关联的噪声统计。 然后，图像处理流水线可以识别图像数据的帧的多个部分，使得多个部分的每个部分具有平坦表面。 然后，图像处理流水线可以为多个部分的每个部分计算多个梯度，为多个部分的每个部分确定一个或多个主要梯度取向，并且生成表示对应于多个部分的多个主要梯度取向的直方图 到多个部分。 在生成直方图之后，图像处理流水线可以将可以表示噪声统计的直方图存储在存储器中。