Image signal processor line buffer configuration for processing ram image data
    1.
    发明授权
    Image signal processor line buffer configuration for processing ram image data 有权
    用于处理原始图像数据的图像信号处理器线缓冲器配置

    公开(公告)号:US08508612B2

    公开(公告)日:2013-08-13

    申请号:US12895396

    申请日:2010-09-30

    IPC分类号: H04N5/228

    CPC分类号: H04N9/045 G06T3/4015

    摘要: The present disclosure provides techniques relates to the implementation of a raw pixel processing unit using a set of line buffers. In one embodiment, the set of line buffers may include a first subset and second subset. Various logical units of the raw pixel processing unit may be implemented using the first and second subsets of line buffers in a shared manner. For instance, in one embodiment, defective pixel correction and detection logic may be implemented using the first subset of line buffers. The second subset of line buffers may be used to implement lens shading correction logic, gain, offset, and clamping logic, and demosaicing logic. Further, noise reduction may also be implemented using at least a portion of each of the first and second subsets of line buffers.

    摘要翻译: 本公开提供了技术涉及使用一组行缓冲器的原始像素处理单元的实现。 在一个实施例中,行缓冲器组可以包括第一子集和第二子集。 可以以共享的方式使用第一和第二子行的行缓冲器来实现原始像素处理单元的各种逻辑单元。 例如,在一个实施例中,可以使用线缓冲器的第一子集来实现有缺陷的像素校正和检测逻辑。 行缓冲器的第二子集可用于实现镜头阴影校正逻辑,增益,偏移和钳位逻辑以及去马赛克逻辑。 此外,还可以使用行缓冲器的第一和第二子集中的每一个的至少一部分来实现噪声降低。

    IMAGE SENSOR DATA FORMATS AND MEMORY ADDRESSING TECHNIQUES FOR IMAGE SIGNAL PROCESSING
    2.
    发明申请
    IMAGE SENSOR DATA FORMATS AND MEMORY ADDRESSING TECHNIQUES FOR IMAGE SIGNAL PROCESSING 有权
    用于图像信号处理的图像传感器数据格式和存储器寻址技术

    公开(公告)号:US20120081577A1

    公开(公告)日:2012-04-05

    申请号:US12895346

    申请日:2010-09-30

    IPC分类号: H04N5/76

    摘要: Certain embodiments of the present disclosure provide a flexible memory input/output controller that is configured to the storing and reading of multiple types of pixels and pixel memory formats. For instance, the memory I/O controller may support the storing and reading of raw image pixels at various bits of precision, such as 8-bit, 10-bit, 12-bit, 14-bit, and 16-bit. Pixel formats that are unaligned with memory bytes (e.g., not being a multiple of 8-bits) may be stored in a packed manner. The memory I/O controller may also support various formats of RGB pixel sets and YCC pixel sets.

    摘要翻译: 本公开的某些实施例提供了一种灵活的存储器输入/输出控制器,其被配置为存储和读取多种类型的像素和像素存储器格式。 例如,存储器I / O控制器可以支持以各种精度位(例如8位,10位,12位,14位和16位)存储和读取原始图像像素。 与存储器字节不对齐的像素格式(例如,不是8位的倍数)可以以打包的方式存储。 存储器I / O控制器还可以支持RGB像素集和YCC像素集的各种格式。

    DUAL IMAGE SENSOR IMAGE PROCESSING SYSTEM AND METHOD
    3.
    发明申请
    DUAL IMAGE SENSOR IMAGE PROCESSING SYSTEM AND METHOD 有权
    双图像传感器图像处理系统和方法

    公开(公告)号:US20120044372A1

    公开(公告)日:2012-02-23

    申请号:US12858922

    申请日:2010-08-18

    IPC分类号: H04N5/225 H04N5/228

    摘要: Various techniques are provided for processing image data acquired using a digital image sensor. In accordance with aspects of the present disclosure, one such technique may relate to the processing of image data in a system that supports multiple image sensors. In one embodiment, the image processing system may include control circuitry configured to determine whether a device is operating in a single sensor mode (one active sensor) or a dual sensor mode (two active sensors). When operating in the single sensor mode, data may be provided directly to a front-end pixel processing unit from the sensor interface of the active sensor. When operating in a dual sensor mode, the image frames from the first and second sensors are provided to the front-end pixel processing unit in an interleaved manner. For instance, in one embodiment, the image frames from the first and second sensors are written to a memory, and then read out to the front-end pixel processing unit in an interleaved manner.

    摘要翻译: 提供了用于处理使用数字图像传感器获取的图像数据的各种技术。 根据本公开的方面,一种这样的技术可以涉及在支持多个图像传感器的系统中对图像数据的处理。 在一个实施例中,图像处理系统可以包括被配置为确定设备是以单个传感器模式(一个有源传感器)或双传感器模式(两个有源传感器)操作的控制电路。 当在单传感器模式下操作时,数据可以从有源传感器的传感器接口直接提供给前端像素处理单元。 当以双传感器模式操作时,来自第一和第二传感器的图像帧以交错的方式提供给前端像素处理单元。 例如,在一个实施例中,来自第一和第二传感器的图像帧被写入存储器,然后以交错的方式读出到前端像素处理单元。

    IMAGE SIGNAL PROCESSOR LINE BUFFER CONFIGURATION FOR PROCESSING RAW IMAGE DATA
    4.
    发明申请
    IMAGE SIGNAL PROCESSOR LINE BUFFER CONFIGURATION FOR PROCESSING RAW IMAGE DATA 有权
    用于处理RAW图像数据的图像信号处理器线缓冲器配置

    公开(公告)号:US20120081578A1

    公开(公告)日:2012-04-05

    申请号:US12895396

    申请日:2010-09-30

    IPC分类号: H04N5/225

    CPC分类号: H04N9/045 G06T3/4015

    摘要: The present disclosure provides techniques relates to the implementation of a raw pixel processing unit using a set of line buffers. In one embodiment, the set of line buffers may include a first subset and second subset. Various logical units of the raw pixel processing unit may be implemented using the first and second subsets of line buffers in a shared manner. For instance, in one embodiment, defective pixel correction and detection logic may be implemented using the first subset of line buffers. The second subset of line buffers may be used to implement lens shading correction logic, gain, offset, and clamping logic, and demosaicing logic. Further, noise reduction may also be implemented using at least a portion of each of the first and second subsets of line buffers.

    摘要翻译: 本公开提供了技术涉及使用一组行缓冲器的原始像素处理单元的实现。 在一个实施例中,行缓冲器组可以包括第一子集和第二子集。 可以以共享的方式使用第一和第二子行的行缓冲器来实现原始像素处理单元的各种逻辑单元。 例如,在一个实施例中,可以使用线缓冲器的第一子集来实现有缺陷的像素校正和检测逻辑。 行缓冲器的第二子集可用于实现镜头阴影校正逻辑,增益,偏移和钳位逻辑以及去马赛克逻辑。 此外,还可以使用行缓冲器的第一和第二子集中的每一个的至少一部分来实现噪声降低。

    Binning compensation filtering techniques for image signal processing
    5.
    发明授权
    Binning compensation filtering techniques for image signal processing 有权
    用于图像信号处理的分级补偿滤波技术

    公开(公告)号:US08525895B2

    公开(公告)日:2013-09-03

    申请号:US12846008

    申请日:2010-07-29

    IPC分类号: H04N5/228 H04N9/64 G06K9/00

    CPC分类号: G06T3/4015

    摘要: Various techniques for applying binning compensation filtering to binned raw image data acquired by an image sensor are provided. In one embodiment, a binning compensation filter (BCF) includes separate digital differential analyzers (DDA) for vertical and horizontal scaling. A current position of an output pixel is determined by incrementing the DDA based upon a step size. Using the known output pixel position, a center source input pixel and an index corresponding to the between-pixel fractional position of the output pixel position relative to the input pixels may be selected for filtering. Using the selected center input pixel, one or more same-colored neighboring source pixels may be selected. The number of selected source pixels may depend on the number of taps used by the scaling logic, and may depend on whether horizontal or vertical scaling is being applied. Using the selected index, a set of filter coefficients may be selected from a filter coefficient lookup table, applied to the selected source pixels, and the results may be summed to determine a value for an output pixel having a position corresponding to the current position of the DDA. This process may be repeated for each input pixel and may be performed in both vertical and horizontal directions, thus ultimately producing a re-sampled set of image data that is spatially evenly distributed.

    摘要翻译: 提供了用于将分档补偿滤波应用于由图像传感器获取的二进制原始图像数据的各种技术。 在一个实施例中,分箱补偿滤波器(BCF)包括用于垂直和水平缩放的单独的数字差分分析器(DDA)。 通过基于步长增加DDA来确定输出像素的当前位置。 使用已知的输出像素位置,可以选择中心源输入像素和对应于输出像素位置相对于输入像素的像素间分数位置的索引用于滤波。 使用所选择的中心输入像素,可以选择一个或多个相同颜色的相邻源像素。 选择的源像素的数量可以取决于缩放逻辑使用的抽头的数量,并且可以取决于是否应用水平或垂直缩放。 使用所选择的索引,可以从应用于所选择的源像素的滤波器系数查找表中选择一组滤波器系数,并且将结果相加以确定具有对应于当前位置的位置的输出像素的值 DDA。 对于每个输入像素可以重复该过程,并且可以在垂直和水平方向上执行该过程,从而最终产生在空间上均匀分布的重新采样的图像数据集。

    Image sensor data formats and memory addressing techniques for image signal processing
    6.
    发明授权
    Image sensor data formats and memory addressing techniques for image signal processing 有权
    用于图像信号处理的图像传感器数据格式和存储器寻址技术

    公开(公告)号:US08508621B2

    公开(公告)日:2013-08-13

    申请号:US12895346

    申请日:2010-09-30

    IPC分类号: H04N5/76

    摘要: Certain embodiments of the present disclosure provide a flexible memory input/output controller that is configured to the storing and reading of multiple types of pixels and pixel memory formats. For instance, the memory I/O controller may support the storing and reading of raw image pixels at various bits of precision, such as 8-bit, 10-bit, 12-bit, 14-bit, and 16-bit. Pixel formats that are unaligned with memory bytes (e.g., not being a multiple of 8-bits) may be stored in a packed manner. The memory I/O controller may also support various formats of RGB pixel sets and YCC pixel sets.

    摘要翻译: 本公开的某些实施例提供了一种灵活的存储器输入/输出控制器,其被配置为存储和读取多种类型的像素和像素存储器格式。 例如,存储器I / O控制器可以支持以各种精度位(例如8位,10位,12位,14位和16位)存储和读取原始图像像素。 与存储器字节不对齐的像素格式(例如,不是8位的倍数)可以以打包的方式存储。 存储器I / O控制器还可以支持RGB像素集和YCC像素集的各种格式。

    BINNING COMPENSATION FILTERING TECHNIQUES FOR IMAGE SIGNAL PROCESSING
    7.
    发明申请
    BINNING COMPENSATION FILTERING TECHNIQUES FOR IMAGE SIGNAL PROCESSING 有权
    用于图像信号处理的BINNING补偿滤波技术

    公开(公告)号:US20120026368A1

    公开(公告)日:2012-02-02

    申请号:US12846008

    申请日:2010-07-29

    IPC分类号: H04N9/64

    CPC分类号: G06T3/4015

    摘要: Various techniques for applying binning compensation filtering to binned raw image data acquired by an image sensor are provided. In one embodiment, a binning compensation filter (BCF) includes separate digital differential analyzers (DDA) for vertical and horizontal scaling. A current position of an output pixel is determined by incrementing the DDA based upon a step size. Using the known output pixel position, a center source input pixel and an index corresponding to the between-pixel fractional position of the output pixel position relative to the input pixels may be selected for filtering. Using the selected center input pixel, one or more same-colored neighboring source pixels may be selected. The number of selected source pixels may depend on the number of taps used by the scaling logic, and may depend on whether horizontal or vertical scaling is being applied. Using the selected index, a set of filter coefficients may be selected from a filter coefficient lookup table, applied to the selected source pixels, and the results may be summed to determine a value for an output pixel having a position corresponding to the current position of the DDA. This process may be repeated for each input pixel and may be performed in both vertical and horizontal directions, thus ultimately producing a re-sampled set of image data that is spatially evenly distributed.

    摘要翻译: 提供了用于将分档补偿滤波应用于由图像传感器获取的二进制原始图像数据的各种技术。 在一个实施例中,分箱补偿滤波器(BCF)包括用于垂直和水平缩放的单独的数字差分分析器(DDA)。 通过基于步长增加DDA来确定输出像素的当前位置。 使用已知的输出像素位置,可以选择中心源输入像素和对应于输出像素位置相对于输入像素的像素间分数位置的索引用于滤波。 使用所选择的中心输入像素,可以选择一个或多个相同颜色的相邻源像素。 选择的源像素的数量可以取决于缩放逻辑使用的抽头的数量,并且可以取决于是否应用水平或垂直缩放。 使用所选择的索引,可以从应用于所选择的源像素的滤波器系数查找表中选择一组滤波器系数,并且将结果相加以确定具有对应于当前位置的位置的输出像素的值 DDA。 对于每个输入像素可以重复该过程,并且可以在垂直和水平方向上执行该过程,从而最终产生在空间上均匀分布的重新采样的图像数据集。

    Dual image sensor image processing system and method
    8.
    发明授权
    Dual image sensor image processing system and method 有权
    双图像传感器图像处理系统及方法

    公开(公告)号:US08493482B2

    公开(公告)日:2013-07-23

    申请号:US12858922

    申请日:2010-08-18

    IPC分类号: H04N3/14 H04N5/335 H01L31/062

    摘要: Various techniques are provided for processing image data acquired using a digital image sensor. In accordance with aspects of the present disclosure, one such technique may relate to the processing of image data in a system that supports multiple image sensors. In one embodiment, the image processing system may include control circuitry configured to determine whether a device is operating in a single sensor mode (one active sensor) or a dual sensor mode (two active sensors). When operating in the single sensor mode, data may be provided directly to a front-end pixel processing unit from the sensor interface of the active sensor. When operating in a dual sensor mode, the image frames from the first and second sensors are provided to the front-end pixel processing unit in an interleaved manner. For instance, in one embodiment, the image frames from the first and second sensors are written to a memory, and then read out to the front-end pixel processing unit in an interleaved manner.

    摘要翻译: 提供了用于处理使用数字图像传感器获取的图像数据的各种技术。 根据本公开的方面,一种这样的技术可以涉及在支持多个图像传感器的系统中对图像数据的处理。 在一个实施例中,图像处理系统可以包括被配置为确定设备是以单个传感器模式(一个有源传感器)或双传感器模式(两个有源传感器)操作的控制电路。 当在单传感器模式下操作时,数据可以从有源传感器的传感器接口直接提供给前端像素处理单元。 当以双传感器模式操作时,来自第一和第二传感器的图像帧以交错的方式提供给前端像素处理单元。 例如,在一个实施例中,来自第一和第二传感器的图像帧被写入存储器,然后以交错的方式读出到前端像素处理单元。

    Systems and methods for RGB image processing
    9.
    发明授权
    Systems and methods for RGB image processing 有权
    RGB图像处理系统和方法

    公开(公告)号:US09332239B2

    公开(公告)日:2016-05-03

    申请号:US13484814

    申请日:2012-05-31

    摘要: Systems and methods for processing image data in RGB format are provided. In one example, an electronic device includes memory to store image data in raw or RGB format, or both, and an RGB image processing pipeline to process the image data. Specifically, the RGB image processing pipeline may process the image data regardless of whether the image data is of raw or RGB format. The RGB image processing pipeline may include receiving logic to receive the image data in raw or RGB format and demosaicing logic to, when the receiving logic receives the image data in raw format, convert the image data into RGB format. The logic may include local tone mapping logic configured to apply spatially varying tone curves to the image data, a color correction matrix configured to correct color in the image data, and gamma logic configured to transform the image data into gamma space.

    摘要翻译: 提供了以RGB格式处理图像数据的系统和方法。 在一个示例中,电子设备包括用于以原始或RGB格式或两者存储图像数据的存储器和用于处理图像数据的RGB图像处理流水线。 具体而言,RGB图像处理流水线可以处理图像数据,而不管图像数据是原始还是RGB格式。 RGB图像处理流水线可以包括接收逻辑以接收原始或RGB格式的图像数据和去马赛克逻辑,当接收逻辑以原始格式接收图像数据时,将图像数据转换为RGB格式。 逻辑可以包括被配置为将空间变化的色调曲线应用于图像数据的本地色调映射逻辑,配置为校正图像数据中的颜色的色彩校正矩阵,以及被配置为将图像数据变换为伽马空间的伽马逻辑。

    User interface pipe scalers with active regions
    10.
    发明授权
    User interface pipe scalers with active regions 有权
    用户界面管道缩放器与活动区域

    公开(公告)号:US08717391B2

    公开(公告)日:2014-05-06

    申请号:US12950267

    申请日:2010-11-19

    IPC分类号: G09G5/00 G06F13/00 G09G5/02

    摘要: A display pipe may include fetch circuitry and a scaler unit, and registers programmable with information that defines active regions of an image frame. Pixels within the active regions are active pixels to be displayed, pixels outside of the active regions are inactive pixels not to be displayed. The fetch circuitry may retrieve frames from memory, retrieving the active pixels and not retrieving the inactive pixels as defined by the programmed contents of the registers. A scaler unit may produce scaled pixels from the fetched pixels, basing each scaled pixel on a respective corresponding set of pixels. When a given pixel of the respective corresponding set of pixels is an inactive pixel, the scaler unit may assign an estimated value to the given pixel based on one or more active pixels in the respective corresponding set of pixels. The scaler unit may provide the scaled pixels to a blend unit for blending with other pixels.

    摘要翻译: 显示管可以包括提取电路和缩放器单元,并且可以用定义图像帧的有效区域的信息来编程。 活动区域内的像素是要显示的活动像素,活动区域之外的像素是不显示的不活动像素。 提取电路可以从存储器检索帧,检索有效像素,而不检索由寄存器的编程内容定义的非活动像素。 缩放器单元可以从获取的像素产生缩放的像素,将每个缩放的像素基于相应的相应的像素集。 当相应的相应像素集合的给定像素是非活动像素时,缩放器单元可以基于相应的相应像素集合中的一个或多个有效像素来分配给定像素的估计值。 缩放器单元可以将缩放的像素提供给用于与其他像素混合的混合单元。