公开(公告)号：US08270774B2

公开(公告)日：2012-09-18

申请号：US12057211

申请日：2008-03-27

申请人： Fumihito Yasuma ,  Tomoo Mitsunaga

发明人： Fumihito Yasuma ,  Tomoo Mitsunaga

IPC分类号： G06K9/00 ,  G06K9/32

CPC分类号： H04N9/045

摘要： An image processing device includes: an interpolation unit configured to perform interpolation along each of a plurality of directions in a neighbor region of a predetermined pixel of interest in an input image, and generate interpolation values for each; a chroma signal alias intensity calculating unit configured to calculate alias intensities of chroma signals from interpolation values of each of the plurality of directions from the interpolation unit; and a direction evaluation unit configured to generate evaluation values corresponding to each of the plurality of directions, based on the alias intensity of each of the chroma signals of the plurality of directions from the chroma signal alias intensity calculating unit.

摘要翻译： 图像处理装置包括：内插单元，被配置为在输入图像中的感兴趣的预定像素的相邻区域中的多个方向中的每一个上执行内插，并且生成每个的内插值; 色度信号别名强度计算单元，被配置为从所述插值单元计算来自所述多个方向中的每一个的插值的色度信号的别名强度; 以及方向评估单元，被配置为基于来自所述色度信号别名强度计算单元的所述多个方向的每个色度信号的别名强度，生成与所述多个方向中的每一个相对应的评估值。

公开(公告)号：US08248492B2

公开(公告)日：2012-08-21

申请号：US12530251

申请日：2009-01-23

申请人： Tomoo Mitsunaga

发明人： Tomoo Mitsunaga

IPC分类号： H04N5/208 ,  G06K9/40

CPC分类号： H04N1/6027 ,  G06T5/002 ,  G06T5/40 ,  G06T2207/20012 ,  G06T2207/20021 ,  G06T2207/20192 ,  H04N1/58 ,  H04N1/6005

摘要： This present invention relates to an image processing apparatus capable of performing edge preserving smoothing processing with less operations, an image processing method, and a program. The block-histogram calculation unit 113 calculates the number of pixels, as a block histogram, included in each of luminance blocks which are obtained by dividing a luminance image in a spatial direction and a luminance direction. The block-integration value 115 calculates an integration value of luminance values of the pixels included in each of the luminance blocks as a block integration value. The weighted product-sum unit 117 calculates a general-luminance value representing average luminance of an object region to which a pixel being processed belongs using the block integration value, the block histogram, and the luminance value of the pixel being processed. This invention is applicable to digital video cameras.

摘要翻译： 本发明涉及能够以较少的操作执行边缘保持平滑处理的图像处理装置，图像处理方法和程序。 块直方图计算单元113计算通过在空间方向和亮度方向上分割亮度图像而获得的亮度块中包含的每个亮度块中包括的像素数，作为块直方图。 块积分值115将包括在每个亮度块中的像素的亮度的积分值计算为块积分值。 加权积和单元117使用块积分值，块直方图和正在处理的像素的亮度值来计算表示被处理像素所属的对象区域的平均亮度的一般亮度值。 本发明适用于数字摄像机。

公开(公告)号：US08116563B2

公开(公告)日：2012-02-14

申请号：US12026311

申请日：2008-02-05

申请人： Tomoo Mitsunaga

发明人： Tomoo Mitsunaga

IPC分类号： G06K9/00

CPC分类号： H04N5/20 ,  H04N5/57 ,  H04N9/68 ,  H04N21/44008 ,  H04N21/4402

摘要： An image processing device for processing image data includes: a gray level transforming processing unit which receives input, of image data, performs gray level transforming, and outputs image data having all of multiple color information by each pixel being configured of one of the multiple color information; the gray level transforming processing unit further including a first gray value computing unit for computing a first gray value according to the brightness of a pixel of interest which exists in a pixel location of interest; a second gray value computing unit for computing a second gray value by gray value transforming as to the first gray value; and pixel value gray level transforming unit for computing a pixel value subjected to gray level transforming of the pixel of interest, based on the first gray value, the second gray value, and the pixel value of the pixel of interest.

摘要翻译： 用于处理图像数据的图像处理装置包括：灰度级变换处理单元，其接收图像数据的输入，执行灰度级变换，并且通过由多个颜色中的一个配置的每个像素输出具有所有多个颜色信息的图像数据 信息; 所述灰度级变换处理单元还包括第一灰度值计算单元，用于根据感兴趣的像素位置中存在的感兴趣像素的亮度来计算第一灰度值; 第二灰度值计算单元，用于通过对于所述第一灰度值进行灰度值变换来计算第二灰度值; 以及像素值灰度级变换单元，用于基于所述第一灰度值，所述第二灰度值和所述感兴趣像素的像素值计算进行所述感兴趣像素的灰度级变换的像素值。

公开(公告)号：US20110157419A1

公开(公告)日：2011-06-30

申请号：US13045270

申请日：2011-03-10

申请人： Shree K. Nayar ,  Tomoo Mitsunaga

发明人： Shree K. Nayar ,  Tomoo Mitsunaga

IPC分类号： H04N5/235

CPC分类号： H04N5/2355 ,  H04N5/235

摘要： Apparatus and methods are provided for obtaining high dynamic range images using a low dynamic range image sensor. The scene is exposed to the image sensor in a spatially varying manner. A variable-transmittance mask, which is interposed between the scene and the image sensor, imposes a spatially varying attenuation on the scene light incident on the image sensor. The mask includes light transmitting cells whose transmittance is controlled by application of suitable control signals. The mask is configured to generate a spatially varying light attenuation pattern across the image sensor. The image frame sensed by the image sensor is normalized with respect to the spatially varying light attenuation pattern. The normalized image data can be interpolated to account for image sensor pixels that are either under or over exposed to enhance the dynamic range of the image sensor.

摘要翻译： 提供了使用低动态范围图像传感器获得高动态范围图像的装置和方法。 场景以空间变化的方式暴露于图像传感器。 介于场景和图像传感器之间的可变透射掩模对入射在图像传感器上的场景光强加空间变化的衰减。 掩模包括通过施加适当的控制信号来控制透光率的透光单元。 掩模被配置为在图像传感器上产生空间变化的光衰减图案。 由图像传感器感测的图像帧相对于空间变化的光衰减图案被归一化。 可以对归一化图像数据进行内插，以考虑到暴露于或超过曝光的图像传感器像素，以增强图像传感器的动态范围。

公开(公告)号：US20110050934A1

公开(公告)日：2011-03-03

申请号：US12530251

申请日：2009-01-23

申请人： Tomoo Mitsunaga

发明人： Tomoo Mitsunaga

IPC分类号： H04N5/228

CPC分类号： H04N1/6027 ,  G06T5/002 ,  G06T5/40 ,  G06T2207/20012 ,  G06T2207/20021 ,  G06T2207/20192 ,  H04N1/58 ,  H04N1/6005

摘要： This invention relates to an image processing apparatus for performing edge preserving smoothing with fewer operations, and a method and a program for the same. A block histogram calculating part 113 calculates the number of pixels belonging to each luminance block as a block histogram for each luminance block obtained by dividing a luminance image in the space direction and in the luminance direction. Block integration value calculation part 115 calculates an integration value for luminance value for the pixels belonging to the luminance block as a block integration value for each luminance block. Weighted sum of product part 117 calculates a general luminance value indicating an average luminance in an object field to which the pixel subject to processing belongs from the block integration value, block histogram and the luminance value for the processing subject pixel for the luminance image. This invention can be applied to a digital video camera.

摘要翻译： 本发明涉及一种用于以更少的操作执行边缘保持平滑的图像处理装置，以及用于其的方法和程序。 块直方图计算部113将属于每个亮度块的像素数作为通过在空间方向和亮度方向上分割亮度图像获得的每个亮度块的块直方图来计算。 块积分值计算部115计算属于亮度块的像素的亮度值的积分值作为每个亮度块的块积分值。 乘积部117的加权和根据块积分值，块直方图以及亮度图像的处理对象像素的亮度值，计算表示被处理对象的像素所属的物体的平均亮度的一般亮度值。 本发明可应用于数字摄像机。

公开(公告)号：US07710476B2

公开(公告)日：2010-05-04

申请号：US11714261

申请日：2007-03-06

申请人： Yoshikuni Nomura ,  Tomoo Mitsunaga

发明人： Yoshikuni Nomura ,  Tomoo Mitsunaga

IPC分类号： H04N3/14 ,  H04N5/335 ,  H04N9/04 ,  H04N9/083

CPC分类号： F21V9/08 ,  H01L27/146 ,  H04N9/045

摘要： A color filter array includes a plurality of filters, each having one of a plurality of types of spectral sensitivity and being disposed at the location of a corresponding one of a plurality of pixels. The filters of a predetermined type selected from among the plurality of types are arranged at the locations of the pixels in a checkered pattern, and the filters of some or all of the other types are randomly arranged at the pixel locations at which the filters of the predetermined type are not present.

摘要翻译： 滤色器阵列包括多个滤光器，每个滤光器具有多种类型的光谱灵敏度中的一种，并且被设置在多个像素中相应的一个像素的位置处。 从多个类型中选择的预定类型的滤波器以方格图案布置在像素的位置处，并且其它类型中的一些或全部的滤波器被随机地布置在像素位置处， 不存在预定类型。

公开(公告)号：US20080247662A1

公开(公告)日：2008-10-09

申请号：US12057189

申请日：2008-03-27

申请人： Fumihito Yasuma ,  Tomoo Mitsunaga

发明人： Fumihito Yasuma ,  Tomoo Mitsunaga

IPC分类号： G06K9/40 ,  G06K9/32

CPC分类号： H04N9/045 ,  G06T3/4015

摘要： An image processing device includes: a first smoothing unit calculating, regarding multiple positions along a first direction in a neighbor region of a predetermined pixel of interest in an input image, a first-stage smoothing value wherein pixel values have been smoothed along a second direction differing from the first, for a first channel; a second smoothing unit calculating, regarding multiple positions along the first direction in the neighbor region, a first-stage smoothing value wherein pixel values have been smoothed along the second direction, for a second channel; an intensity estimating unit estimating the intensity of the first-stage smoothing value of the second channel, based on the first-stage smoothing values of the first and second channels; and a third smoothing unit calculating a second-stage smoothing value for the second channel, the first-stage smoothing value of the second channel intensity-estimated by the intensity estimating unit having been smoothed along the first direction.

摘要翻译： 一种图像处理装置包括：第一平滑单元，计算关于在输入图像中的感兴趣的预定像素的相邻区域中沿着第一方向的多个位置的第一平滑值，其中像素值沿着第二方向被平滑 与第一个渠道不同; 第二平滑单元计算关于相邻区域中沿着第一方向的多个位置的第一平滑值，其中像素值已经沿着第二方向被平滑，对于第二通道; 强度估计单元，基于第一和第二信道的第一级平滑值估计第二信道的第一级平滑值的强度; 以及计算第二通道的第二级平滑值的第三平滑单元，由强度估计单元估计的第二通道强度的第一级平滑值沿着第一方向被平滑化。

公开(公告)号：US07362894B2

公开(公告)日：2008-04-22

申请号：US10731237

申请日：2003-12-10

申请人： Hiroaki Ono ,  Tomoo Mitsunaga

发明人： Hiroaki Ono ,  Tomoo Mitsunaga

IPC分类号： G06K9/00 ,  G03F3/08

CPC分类号： H04N9/045

摘要： In an image processing apparatus, a sensitivity compensation unit converts a color-and-sensitivity mosaic image into a color mosaic image. A pixel-of-interest determination unit extracts local area information from the color mosaic image. An edge-direction detector detects an edge of the local area. A G-component computing unit performs weighted interpolation in the edge direction of the green (G) component associated with a pixel of interest. A statistic computing unit computes statistic information of the local area. A first or second R-and-B-component computing unit computes the red (R) and blue (B) components of the pixel of interest on the basis of the statistic information. An inverse gamma conversion unit performs inverse gamma conversion of the red (R), green (G), and blue (B) components of the pixel of interest. The present invention is applicable to, for example, a digital still camera.

摘要翻译： 在图像处理装置中，灵敏度补偿单元将彩色和马赛克图像转换为彩色马赛克图像。 感兴趣像素确定单元从彩色马赛克图像中提取局部区域信息。 边缘方向检测器检测局部区域的边缘。 G分量计算单元在与感兴趣像素相关联的绿色（G）分量的边缘方向上执行加权内插。 统计计算单元计算局部区域的统计信息。 第一或第二R和B分量计算单元基于统计信息来计算感兴趣像素的红色（R）和蓝色（B）分量。 逆伽马转换单元执行感兴趣像素的红（R），绿（G）和蓝（B）分量的反伽马转换。 本发明可应用于例如数字静态照相机。

公开(公告)号：US20070053607A1

公开(公告)日：2007-03-08

申请号：US11500386

申请日：2006-08-08

申请人： Tomoo Mitsunaga

发明人： Tomoo Mitsunaga

IPC分类号： G06K9/40

CPC分类号： H04N5/20 ,  H04N5/57 ,  H04N5/772 ,  H04N5/907 ,  H04N9/69

摘要： An image processing apparatus tone-compresses input luminance values representing luminance values of an input image. The image processing apparatus includes a conversion-curve calculator configured to calculate a conversion curve that is used for tone-compressing luminance values, on the basis of a distribution of the input luminance values; a global-luminance calculator configured to calculate global luminance values representing luminance values of a global-luminance image composed of low-frequency components of the input image; a tone compressor configured to tone-compress the input luminance values and the global luminance values according to the conversion curve; and a contrast corrector configured to correct contrast of a tone-compressed input image composed of the tone-compressed input luminance values, on the basis of a slope of the conversion curve and the tone-compressed global luminance values.

摘要翻译： 图像处理装置对表示输入图像的亮度值的输入亮度值进行色调压缩。 图像处理装置包括转换曲线计算器，被配置为基于输入亮度值的分布来计算用于色调压缩亮度值的转换曲线; 全局亮度计算器，被配置为计算表示由输入图像的低频分量组成的全局亮度图像的亮度值的全局亮度值; 音调压缩器，被配置为根据转换曲线对输入亮度值和全局亮度值进行色调压缩; 以及对比度校正器，被配置为基于转换曲线的斜率和色调压缩的全局亮度值来校正由色调压缩输入亮度值组成的色调压缩输入图像的对比度。

公开(公告)号：US06864916B1

公开(公告)日：2005-03-08

申请号：US09326422

申请日：1999-06-04

申请人： Shree K. Nayar ,  Tomoo Mitsunaga

发明人： Shree K. Nayar ,  Tomoo Mitsunaga

IPC分类号： H01L27/14 ,  H04N1/407 ,  H04N5/235 ,  H04N5/238 ,  H04N5/243 ,  H04N9/73

CPC分类号： H04N5/2355 ,  H04N5/235

摘要： Apparatus and methods are provided for obtaining high dynamic range images using a low dynamic range image sensor. The image of a scene is captured with an image sensor using a spatially varying exposure function. The spatially varying exposure function can be implemented in a number of ways, such as by using as an optical mask with a fixed spatial attenuation pattern or by using an array of light sensing elements having spatially varying photosensitivities. The captured image is then normalized with respect to the spatially varying exposure function. The normalized image data can be interpolated to account for pixels that are either saturated or blackened to enhance the dynamic range of the image sensor.

摘要翻译： 提供了使用低动态范围图像传感器获得高动态范围图像的装置和方法。 使用空间变化曝光功能的图像传感器拍摄场景的图像。 空间变化的曝光功能可以以多种方式实现，例如通过使用具有固定的空间衰减图案的光学掩模或通过使用具有空间变化光敏度的光感测元件的阵列。 捕获的图像然后相对于空间变化的曝光功能被归一化。 归一化图像数据可被内插以考虑饱和或变黑的像素以增强图像传感器的动态范围。