System and method for processing image data using an image signal processor having back-end processing logic
    1.
    发明授权
    System and method for processing image data using an image signal processor having back-end processing logic 有权
    使用具有后端处理逻辑的图像信号处理器处理图像数据的系统和方法

    公开(公告)号:US08786625B2

    公开(公告)日:2014-07-22

    申请号:US12894833

    申请日:2010-09-30

    IPC分类号: G09G5/02

    摘要: Disclosed embodiments provide for a an image signal processing system that includes back-end pixel processing unit that receives pixel data after being processed by at least one of a front-end pixel processing unit and a pixel processing pipeline. In certain embodiments, the back-end processing unit receives luma/chroma image data and may be configured to apply face detection operations, local tone mapping, bright, contrast, color adjustments, as well as scaling. Further, the back-end processing unit may also include a back-end statistics unit that may collect frequency statistics. The frequency statistics may be provided to an encoder and may be used to determine quantization parameters that are to be applied to an image frame.

    摘要翻译: 公开的实施例提供一种图像信号处理系统,其包括后端像素处理单元,其在由前端像素处理单元和像素处理流水线中的至少一个处理之后接收像素数据。 在某些实施例中,后端处理单元接收亮度/色度图像数据,并且可以被配置为应用面部检测操作,局部色调映射,亮度,对比度,颜色调整以及缩放。 此外,后端处理单元还可以包括可以收集频率统计的后端统计单元。 频率统计可以提供给编码器,并且可以用于确定要应用于图像帧的量化参数。

    Flexible color space selection for auto-white balance processing
    2.
    发明授权
    Flexible color space selection for auto-white balance processing 有权
    自动白平衡处理灵活的色彩空间选择

    公开(公告)号:US08605167B2

    公开(公告)日:2013-12-10

    申请号:US12873973

    申请日:2010-09-01

    IPC分类号: H04N9/73

    CPC分类号: H04N9/735 H04N5/235 H04N9/045

    摘要: Various techniques are disclosed for processing statistics data in an image signal processor (ISP). In one embodiment, a statistics collection engine may be configured to acquire statistics relating to auto white-balance. The statistics collection engine may receive raw Bayer RGB data acquired by an image sensor and may be configured to perform one or more color space conversions to obtain pixel data in other color spaces. A set of pixel filters may be configured to accumulate sums of the pixel data conditionally based upon YC1C2 characteristics, as defined by a pixel condition per pixel filter. Depending on a selected color space, the pixel filters may generate color sums, which may be used to match a current illuminant against a set of reference illuminants with which the image sensor has been previously calibrated.

    摘要翻译: 公开了用于处理图像信号处理器(ISP)中的统计数据的各种技术。 在一个实施例中,统计收集引擎可以被配置为获取与自动白平衡有关的统计。 统计收集引擎可以接收由图像传感器获取的原始拜耳RGB数据,并且可以被配置为执行一个或多个颜色空间转换以获得其他颜色空间中的像素数据。 一组像素滤波器可以被配置为基于每像素滤波器的像素条件定义的YC1C2特性有条件地累加像素数据的和。 根据所选择的颜色空间,像素滤波器可以生成颜色和,其可以用于将当前光源与图像传感器已经被预先校准的一组参考光源相匹配。

    Dual image sensor image processing system and method
    3.
    发明授权
    Dual image sensor image processing system and method 有权
    双图像传感器图像处理系统及方法

    公开(公告)号:US08493482B2

    公开(公告)日:2013-07-23

    申请号:US12858922

    申请日:2010-08-18

    IPC分类号: H04N3/14 H04N5/335 H01L31/062

    摘要: Various techniques are provided for processing image data acquired using a digital image sensor. In accordance with aspects of the present disclosure, one such technique may relate to the processing of image data in a system that supports multiple image sensors. In one embodiment, the image processing system may include control circuitry configured to determine whether a device is operating in a single sensor mode (one active sensor) or a dual sensor mode (two active sensors). When operating in the single sensor mode, data may be provided directly to a front-end pixel processing unit from the sensor interface of the active sensor. When operating in a dual sensor mode, the image frames from the first and second sensors are provided to the front-end pixel processing unit in an interleaved manner. For instance, in one embodiment, the image frames from the first and second sensors are written to a memory, and then read out to the front-end pixel processing unit in an interleaved manner.

    摘要翻译: 提供了用于处理使用数字图像传感器获取的图像数据的各种技术。 根据本公开的方面,一种这样的技术可以涉及在支持多个图像传感器的系统中对图像数据的处理。 在一个实施例中,图像处理系统可以包括被配置为确定设备是以单个传感器模式(一个有源传感器)或双传感器模式(两个有源传感器)操作的控制电路。 当在单传感器模式下操作时,数据可以从有源传感器的传感器接口直接提供给前端像素处理单元。 当以双传感器模式操作时,来自第一和第二传感器的图像帧以交错的方式提供给前端像素处理单元。 例如,在一个实施例中,来自第一和第二传感器的图像帧被写入存储器,然后以交错的方式读出到前端像素处理单元。

    Memory compression technique with low latency per pixel
    4.
    发明授权
    Memory compression technique with low latency per pixel 有权
    内存压缩技术,每像素低延迟

    公开(公告)号:US08378859B2

    公开(公告)日:2013-02-19

    申请号:US12872500

    申请日:2010-08-31

    IPC分类号: H03M7/30 G06K9/36

    摘要: In an embodiment, a compression unit is provided which may perform compression of images with low latency and relatively little hardware. Similarly, a decompression unit may be provided which may decompress the images with low latency and hardware. In an embodiment, the transmission of compressed coefficients may be performed using less than two passes through the list of coefficients. During the first pass, the most significant coefficients may be transmitted and other significance groups may be identified as linked lists. The linked lists may then be traverse to send the other significance groups. In an embodiment, a color space conversion may be made to permit filtering of fewer color components than might be possible in the source color space.

    摘要翻译: 在一个实施例中,提供了压缩单元,其可以执行具有低延迟和相对较少硬件的图像的压缩。 类似地,可以提供可以以低延迟和硬件解压缩图像的解压缩单元。 在一个实施例中,可以使用少于两次通过系数列表来执行压缩系数的传输。 在第一次通过期间,可以发送最重要的系数,并且可以将其他重要组识别为链表。 然后可以遍历链接列表以发送其他重要组。 在一个实施例中,可以进行颜色空间转换以允许对源颜色空间中可能的颜色分量进行滤波。

    TECHNIQUES FOR COLLECTION OF AUTO-FOCUS STATISTICS
    5.
    发明申请
    TECHNIQUES FOR COLLECTION OF AUTO-FOCUS STATISTICS 有权
    收集自动聚焦统计的技术

    公开(公告)号:US20120050566A1

    公开(公告)日:2012-03-01

    申请号:US12873989

    申请日:2010-09-01

    IPC分类号: H04N9/73

    摘要: Various techniques are disclosed for collecting and processing auto-focus statistics data in an image signal processor (ISP). In one embodiment, a statistics collection engine in an ISP front-end processing unit may be configured to collect coarse (based on decimated raw data) and fine auto-focus statistics. Coarse auto-focus statistics may be collected on decimated Bayer RGB data and/or on linear camera luma values. Fine auto-focus statistics may be collected on raw Bayer RGB using a combination of a horizontal filter and edge detector, or may be collected on BayerY data (by applying a 3×1 transform to the raw Bayer RGB data). Edge sums may be accumulated using the filter outputs to determine auto-focus statistics.

    摘要翻译: 公开了用于在图像信号处理器(ISP)中收集和处理自动对焦统计数据的各种技术。 在一个实施例中,ISP前端处理单元中的统计收集引擎可以被配置为收集粗略(基于抽取的原始数据)和精细的自动对焦统计。 可以在抽取的拜耳RGB数据和/或线性相机亮度值上收集粗略的自动对焦统计数据。 可以使用水平滤波器和边缘检测器的组合在原始拜耳RGB上收集精细的自动对焦统计信息,或者可以在拜耳数据上收集(通过对原始拜耳RGB数据应用3×1变换)。 可以使用滤波器输出积累边沿和,以确定自动对焦统计。

    DUAL IMAGE SENSOR IMAGE PROCESSING SYSTEM AND METHOD
    6.
    发明申请
    DUAL IMAGE SENSOR IMAGE PROCESSING SYSTEM AND METHOD 有权
    双图像传感器图像处理系统和方法

    公开(公告)号:US20120044372A1

    公开(公告)日:2012-02-23

    申请号:US12858922

    申请日:2010-08-18

    IPC分类号: H04N5/225 H04N5/228

    摘要: Various techniques are provided for processing image data acquired using a digital image sensor. In accordance with aspects of the present disclosure, one such technique may relate to the processing of image data in a system that supports multiple image sensors. In one embodiment, the image processing system may include control circuitry configured to determine whether a device is operating in a single sensor mode (one active sensor) or a dual sensor mode (two active sensors). When operating in the single sensor mode, data may be provided directly to a front-end pixel processing unit from the sensor interface of the active sensor. When operating in a dual sensor mode, the image frames from the first and second sensors are provided to the front-end pixel processing unit in an interleaved manner. For instance, in one embodiment, the image frames from the first and second sensors are written to a memory, and then read out to the front-end pixel processing unit in an interleaved manner.

    摘要翻译: 提供了用于处理使用数字图像传感器获取的图像数据的各种技术。 根据本公开的方面,一种这样的技术可以涉及在支持多个图像传感器的系统中对图像数据的处理。 在一个实施例中,图像处理系统可以包括被配置为确定设备是以单个传感器模式(一个有源传感器)或双传感器模式(两个有源传感器)操作的控制电路。 当在单传感器模式下操作时,数据可以从有源传感器的传感器接口直接提供给前端像素处理单元。 当以双传感器模式操作时,来自第一和第二传感器的图像帧以交错的方式提供给前端像素处理单元。 例如,在一个实施例中,来自第一和第二传感器的图像帧被写入存储器,然后以交错的方式读出到前端像素处理单元。

    Color Space Conversion for Efficient Filtering
    7.
    发明申请
    Color Space Conversion for Efficient Filtering 审中-公开
    彩色空间转换为高效过滤

    公开(公告)号:US20120014595A1

    公开(公告)日:2012-01-19

    申请号:US12872517

    申请日:2010-08-31

    IPC分类号: G06K9/46

    摘要: In an embodiment, a compression unit is provided which may perform compression of images with low latency and relatively little hardware. Similarly, a decompression unit may be provided which may decompress the images with low latency and hardware. In an embodiment, the transmission of compressed coefficients may be performed using less than two passes through the list of coefficients. During the first pass, the most significant coefficients may be transmitted and other significance groups may be identified as linked lists. The linked lists may then be traverse to send the other significance groups. In an embodiment, a color space conversion may be made to permit filtering of fewer color components than might be possible in the source color space.

    摘要翻译: 在一个实施例中,提供了压缩单元,其可以执行具有低延迟和相对较少硬件的图像的压缩。 类似地,可以提供可以以低延迟和硬件解压缩图像的解压缩单元。 在一个实施例中,可以使用少于两次通过系数列表来执行压缩系数的传输。 在第一次通过期间,可以发送最重要的系数,并且可以将其他重要组识别为链表。 然后可以遍历链接列表以发送其他重要组。 在一个实施例中,可以进行颜色空间转换以允许对源颜色空间中可能的颜色分量进行滤波。

    Memory Compression Technique with Low Latency per Pixel
    8.
    发明申请
    Memory Compression Technique with Low Latency per Pixel 有权
    内存压缩技术,每像素低延迟

    公开(公告)号:US20120013758A1

    公开(公告)日:2012-01-19

    申请号:US12872500

    申请日:2010-08-31

    IPC分类号: G06K9/36 H04N5/228 G06F12/00

    摘要: In an embodiment, a compression unit is provided which may perform compression of images with low latency and relatively little hardware. Similarly, a decompression unit may be provided which may decompress the images with low latency and hardware. In an embodiment, the transmission of compressed coefficients may be performed using less than two passes through the list of coefficients. During the first pass, the most significant coefficients may be transmitted and other significance groups may be identified as linked lists. The linked lists may then be traverse to send the other significance groups. In an embodiment, a color space conversion may be made to permit filtering of fewer color components than might be possible in the source color space.

    摘要翻译: 在一个实施例中,提供了压缩单元,其可以执行具有低延迟和相对较少硬件的图像的压缩。 类似地,可以提供可以以低延迟和硬件解压缩图像的解压缩单元。 在一个实施例中,可以使用少于两次通过系数列表来执行压缩系数的传输。 在第一次通过期间,可以发送最重要的系数,并且可以将其他重要组识别为链表。 然后可以遍历链接列表以发送其他重要组。 在一个实施例中,可以进行颜色空间转换以允许对源颜色空间中可能的颜色分量进行滤波。

    SYSTEM AND METHOD FOR PROCESSING IMAGE DATA USING AN IMAGE PROCESSING PIPELINE OF AN IMAGE SIGNAL PROCESSOR
    9.
    发明申请
    SYSTEM AND METHOD FOR PROCESSING IMAGE DATA USING AN IMAGE PROCESSING PIPELINE OF AN IMAGE SIGNAL PROCESSOR 有权
    使用图像信号处理器的图像处理管线处理图像数据的系统和方法

    公开(公告)号:US20110090381A1

    公开(公告)日:2011-04-21

    申请号:US12789815

    申请日:2010-05-28

    IPC分类号: H04N9/64

    摘要: Various techniques are provided herein for processing raw image data acquired using a digital image sensor in an image processing pipeline of an image signal processing system. In one embodiment, the image processing pipeline may first process the raw image data (e.g., Bayer image data) for the detection and correction of defective pixels. Next, the image processing pipeline may process the raw image data to reduce noise. Thereafter, the image processing pipeline may correct lens shading distortion in the raw image data and, subsequently, apply a demosaicing algorithm to convert the raw image data into full color image data (e.g., RGB image data). The color image data may be further processed by the image processing pipeline to correct color and gamma properties prior to being converted into a luma and chroma color space (e.g., YCbCr color space).

    摘要翻译: 本文提供了用于处理在图像信号处理系统的图像处理流水线中使用数字图像传感器获取的原始图像数据的各种技术。 在一个实施例中,图像处理流水线可以首先处理原始图像数据(例如,拜耳图像数据)以用于缺陷像素的检测和校正。 接下来,图像处理流水线可以处理原始图像数据以降低噪声。 此后,图像处理流水线可以校正原始图像数据中的透镜遮蔽失真,并且随后应用去马赛克算法将原始图像数据转换为全色图像数据(例如,RGB图像数据)。 彩色图像数据可以由图像处理流水线进一步处理,以在被转换为亮度和色度色彩空间(例如,YCbCr颜色空间)之前校正颜色和伽马性质。

    IMAGE SIGNAL PROCESSOR FRONT-END IMAGE DATA PROCESSING SYSTEM AND METHOD
    10.
    发明申请
    IMAGE SIGNAL PROCESSOR FRONT-END IMAGE DATA PROCESSING SYSTEM AND METHOD 有权
    图像信号处理器前端图像数据处理系统和方法

    公开(公告)号:US20110090380A1

    公开(公告)日:2011-04-21

    申请号:US12789810

    申请日:2010-05-28

    IPC分类号: H04N9/64

    摘要: Various techniques are provided herein for processing raw image data in front-end processing logic of an image signal processing system. In one embodiment, the front-end processing logic includes a statistics processing unit configured to process raw image data acquired by an image sensor to obtain one or more sets of statistics. The statistics processing unit may first correct defective pixels in the raw image data and then correct lens shading errors in the raw image data prior to extracting the statistics information. In certain embodiments, black level compensation may be applied between the defective pixel correction and lens shading correction steps, and inverse black level compensation may be applied between the lens shading correction step and the extraction of the statistics information. The acquired statistics information may be utilized by an image signal processing pipeline for converting the raw image data into a color (e.g., RGB) and/or luma (e.g., YCbCr) image.

    摘要翻译: 本文提供了用于在图像信号处理系统的前端处理逻辑中处理原始图像数据的各种技术。 在一个实施例中,前端处理逻辑包括:统计处理单元,被配置为处理由图像传感器获取的原始图像数据,以获得一组或多组统计。 统计处理单元可以首先校正原始图像数据中的缺陷像素,然后在提取统计信息之前校正原始图像数据中的透镜阴影错误。 在某些实施例中,可以在缺陷像素校正和透镜阴影校正步骤之间应用黑电平补偿,并且可以在透镜阴影校正步骤和提取统计信息之间应用反黑电平补偿。 获取的统计信息可以由图像信号处理流水线利用,用于将原始图像数据转换成颜色(例如RGB)和/或亮度(例如,YCbCr)图像。