公开(公告)号：US08749646B2

公开(公告)日：2014-06-10

申请号：US12551705

申请日：2009-09-01

申请人： Tomoo Mitsunaga

发明人： Tomoo Mitsunaga

IPC分类号： H04N5/228

CPC分类号： H04N5/35581 ,  H04N5/23248 ,  H04N5/23254 ,  H04N5/23277 ,  H04N5/235 ,  H04N5/2355 ,  H04N5/35554 ,  H04N5/374 ,  H04N9/045 ,  H04N2209/046

摘要： An image processing apparatus includes: a shaking estimating unit configured to estimate the shaking information of an image generated within a predetermined period of time; a short-time-exposure shaking correcting unit configured to correct the shaking of a plurality of short-time-exposure images generated due to intermittent exposure within the predetermined period of time based on the estimated shaking information; a long-time-exposure shaking correcting unit configured to correct the shaking of a long-time-exposure image generated due to consecutive exposure within the predetermined period of time based on the estimated shaking information; and an image synthesizing unit configured to synthesize the corrected short-time-exposure images and the corrected long-time-exposure image.

摘要翻译： 图像处理装置包括：抖动估计单元，被配置为估计在预定时间段内生成的图像的抖动信息; 短时间曝光抖动校正单元，被配置为基于所估计的抖动信息来校正在预定时间段内由间歇曝光产生的多个短时间曝光图像的抖动; 长时间曝光抖动校正单元，被配置为基于估计的抖动信息校正在预定时间段内由于连续曝光而产生的长时间曝光图像的抖动; 以及图像合成单元，被配置为合成校正的短时间曝光图像和经校正的长时间曝光图像。

公开(公告)号：US08610789B1

公开(公告)日：2013-12-17

申请号：US13104606

申请日：2011-05-10

申请人： Shree K. Nayar ,  Tomoo Mitsunaga

发明人： Shree K. Nayar ,  Tomoo Mitsunaga

IPC分类号： H04N5/228

CPC分类号： H04N5/235 ,  H04N5/35563

摘要： The application provides techniques for obtaining a relatively high dynamic range image of a scene using a relatively low dynamic range image sensor exposed to incident light from the scene for capturing an image. The image sensor has a multiplicity of light-sensing elements in an array and each light sensing element has a particular one of a plurality of sensitivity levels to incident light in accordance with a predetermined sensitivity pattern for the array of light-sensing elements and has a response function. Each light sensing element is responsive to incident light from the scene for producing a captured image brightness value at a corresponding one of a multiplicity of pixel positions of a pixel position array. Each one of the multiplicity of pixel positions corresponds to a particular one of the plurality of sensitivity levels of the light sensing elements.

摘要翻译： 该应用提供了使用暴露于来自场景的入射光以捕获图像的相对低的动态范围图像传感器来获得场景的相对高的动态范围图像的技术。 图像传感器具有阵列中的多个感光元件，并且每个光感测元件根据用于光感测元件阵列的预定灵敏度图案具有对入射光的多个灵敏度水平中的特定一个，并且具有 响应功能。 每个光感测元件响应来自场景的入射光，以在像素位置阵列的多个像素位置中的相应一个处产生捕获的图像亮度值。 多个像素位置中的每一个对应于光感测元件的多个灵敏度级别中的特定一个。

公开(公告)号：US08339487B2

公开(公告)日：2012-12-25

申请号：US12586000

申请日：2009-09-30

申请人： Yoshikuni Nomura ,  Tomoo Mitsunaga

发明人： Yoshikuni Nomura ,  Tomoo Mitsunaga

IPC分类号： H04N3/14 ,  H04N5/335 ,  H04N9/04 ,  H04N9/083

CPC分类号： F21V9/08 ,  H01L27/146 ,  H04N9/045

摘要： A color filter array includes a plurality of filters, each having one of a plurality of types of spectral sensitivity and being disposed at the location of a corresponding one of a plurality of pixels. The filters of a predetermined type selected from among the plurality of types are arranged at the locations of the pixels in a checkered pattern, and the filters of some or all of the other types are randomly arranged at the pixel locations at which the filters of the predetermined type are not present.

摘要翻译： 滤色器阵列包括多个滤光器，每个滤光器具有多种类型的光谱灵敏度中的一种，并且被设置在多个像素中相应的一个像素的位置处。 从多个类型中选择的预定类型的滤波器以方格图案布置在像素的位置处，并且其它类型中的一些或全部的滤波器被随机地布置在像素位置处， 不存在预定类型。

公开(公告)号：US20120314124A1

公开(公告)日：2012-12-13

申请号：US13487682

申请日：2012-06-04

申请人： Shun Kaizu ,  Tomoo Mitsunaga ,  Kensei Jo ,  Teppei Kurita

发明人： Shun Kaizu ,  Tomoo Mitsunaga ,  Kensei Jo ,  Teppei Kurita

IPC分类号： H04N5/235

CPC分类号： H04N5/2353 ,  H04N5/2355 ,  H04N5/3532 ,  H04N5/3535 ,  H04N5/35581

摘要： There is provided an image pickup apparatus including: a control unit generating exposure time control data in which an exposure time of an image sensor is set in pixel region units; and an image sensor inputting the exposure time control data and carrying out image acquisition based on exposure time control in the pixel region units. The control unit successively and sequentially generates the exposure time control data in region units based on luminance information in the pixel region units that form part of a preceding picked-up image and outputs the exposure time control data to the image sensor. The image sensor inputs the exposure time control data in the region units from the control unit and successively and sequentially uses the inputted exposure time control data to carry out the image acquisition based on the exposure time control in the pixel region units.

摘要翻译： 提供一种图像拾取装置，包括：控制单元，产生以像素区域单位设置图像传感器的曝光时间的曝光时间控制数据; 以及图像传感器，其输入曝光时间控制数据，并且基于像素区域单位中的曝光时间控制进行图像采集。 控制单元基于形成先前拍摄图像的一部分的像素区域单位中的亮度信息，依次地依次生成曝光时间控制数据，并将曝光时间控制数据输出到图像传感器。 图像传感器以来自控制单元的区域单位输入曝光时间控制数据，并且依次使用输入的曝光时间控制数据，以像素区域单位的曝光时间控制为基础进行图像采集。

公开(公告)号：US20120281111A1

公开(公告)日：2012-11-08

申请号：US13452977

申请日：2012-04-23

申请人： Kensei Jo ,  Shun Kaizu ,  Tomoo Mitsunaga

发明人： Kensei Jo ,  Shun Kaizu ,  Tomoo Mitsunaga

IPC分类号： H04N5/235

CPC分类号： H04N5/265 ,  G06T5/003 ,  G06T5/50 ,  G06T2207/20224 ,  H04N5/217 ,  H04N5/2355 ,  H04N5/2621 ,  H04N9/045

摘要： Long and short exposure time pixel information are input to pixel information. A long exposure time image set with the pixel values assuming all of the pixels have been exposed for a long time and a short exposure time image set with the pixel values assuming all of the pixels have been exposed for a short time are generated. A point spread function corresponding to the long exposure time image is computed as a long exposure time image PSF. A corrected image is generated using the short exposure time image, the long exposure time image, and the long exposure time image PSF. The corrected image is generated as a wide dynamic range image utilizing the pixel information for the long and short exposure time image. Utilizing the pixel information for the short exposure time image with little blurring, makes the corrected image a high quality corrected image with little blurring.

摘要翻译： 长时间和短曝光时间像素信息被输入到像素信息。 产生具有假定所有像素的像素值的长时间曝光时间图像已被长时间曝光，并且产生假设所有像素的像素值设置的短曝光时间图像已被短时间曝光。 与长曝光时间图像对应的点扩散函数被计算为长曝光时间图像PSF。 使用短曝光时间图像，长曝光时间图像和长曝光时间图像PSF生成校正图像。 利用长曝光时间图像和短曝光时间图像的像素信息，生成校正图像作为宽动态范围图像。 利用少量模糊的短曝光时间图像的像素信息，使得校正图像具有很少模糊的高质量校正图像。

公开(公告)号：US08270774B2

公开(公告)日：2012-09-18

申请号：US12057211

申请日：2008-03-27

申请人： Fumihito Yasuma ,  Tomoo Mitsunaga

发明人： Fumihito Yasuma ,  Tomoo Mitsunaga

IPC分类号： G06K9/00 ,  G06K9/32

CPC分类号： H04N9/045

摘要： An image processing device includes: an interpolation unit configured to perform interpolation along each of a plurality of directions in a neighbor region of a predetermined pixel of interest in an input image, and generate interpolation values for each; a chroma signal alias intensity calculating unit configured to calculate alias intensities of chroma signals from interpolation values of each of the plurality of directions from the interpolation unit; and a direction evaluation unit configured to generate evaluation values corresponding to each of the plurality of directions, based on the alias intensity of each of the chroma signals of the plurality of directions from the chroma signal alias intensity calculating unit.

摘要翻译： 图像处理装置包括：内插单元，被配置为在输入图像中的感兴趣的预定像素的相邻区域中的多个方向中的每一个上执行内插，并且生成每个的内插值; 色度信号别名强度计算单元，被配置为从所述插值单元计算来自所述多个方向中的每一个的插值的色度信号的别名强度; 以及方向评估单元，被配置为基于来自所述色度信号别名强度计算单元的所述多个方向的每个色度信号的别名强度，生成与所述多个方向中的每一个相对应的评估值。

公开(公告)号：US08248492B2

公开(公告)日：2012-08-21

申请号：US12530251

申请日：2009-01-23

申请人： Tomoo Mitsunaga

发明人： Tomoo Mitsunaga

IPC分类号： H04N5/208 ,  G06K9/40

CPC分类号： H04N1/6027 ,  G06T5/002 ,  G06T5/40 ,  G06T2207/20012 ,  G06T2207/20021 ,  G06T2207/20192 ,  H04N1/58 ,  H04N1/6005

摘要： This present invention relates to an image processing apparatus capable of performing edge preserving smoothing processing with less operations, an image processing method, and a program. The block-histogram calculation unit 113 calculates the number of pixels, as a block histogram, included in each of luminance blocks which are obtained by dividing a luminance image in a spatial direction and a luminance direction. The block-integration value 115 calculates an integration value of luminance values of the pixels included in each of the luminance blocks as a block integration value. The weighted product-sum unit 117 calculates a general-luminance value representing average luminance of an object region to which a pixel being processed belongs using the block integration value, the block histogram, and the luminance value of the pixel being processed. This invention is applicable to digital video cameras.

摘要翻译： 本发明涉及能够以较少的操作执行边缘保持平滑处理的图像处理装置，图像处理方法和程序。 块直方图计算单元113计算通过在空间方向和亮度方向上分割亮度图像而获得的亮度块中包含的每个亮度块中包括的像素数，作为块直方图。 块积分值115将包括在每个亮度块中的像素的亮度的积分值计算为块积分值。 加权积和单元117使用块积分值，块直方图和正在处理的像素的亮度值来计算表示被处理像素所属的对象区域的平均亮度的一般亮度值。 本发明适用于数字摄像机。

公开(公告)号：US08116563B2

公开(公告)日：2012-02-14

申请号：US12026311

申请日：2008-02-05

申请人： Tomoo Mitsunaga

发明人： Tomoo Mitsunaga

IPC分类号： G06K9/00

CPC分类号： H04N5/20 ,  H04N5/57 ,  H04N9/68 ,  H04N21/44008 ,  H04N21/4402

摘要： An image processing device for processing image data includes: a gray level transforming processing unit which receives input, of image data, performs gray level transforming, and outputs image data having all of multiple color information by each pixel being configured of one of the multiple color information; the gray level transforming processing unit further including a first gray value computing unit for computing a first gray value according to the brightness of a pixel of interest which exists in a pixel location of interest; a second gray value computing unit for computing a second gray value by gray value transforming as to the first gray value; and pixel value gray level transforming unit for computing a pixel value subjected to gray level transforming of the pixel of interest, based on the first gray value, the second gray value, and the pixel value of the pixel of interest.

摘要翻译： 用于处理图像数据的图像处理装置包括：灰度级变换处理单元，其接收图像数据的输入，执行灰度级变换，并且通过由多个颜色中的一个配置的每个像素输出具有所有多个颜色信息的图像数据 信息; 所述灰度级变换处理单元还包括第一灰度值计算单元，用于根据感兴趣的像素位置中存在的感兴趣像素的亮度来计算第一灰度值; 第二灰度值计算单元，用于通过对于所述第一灰度值进行灰度值变换来计算第二灰度值; 以及像素值灰度级变换单元，用于基于所述第一灰度值，所述第二灰度值和所述感兴趣像素的像素值计算进行所述感兴趣像素的灰度级变换的像素值。

公开(公告)号：US20110157419A1

公开(公告)日：2011-06-30

申请号：US13045270

申请日：2011-03-10

申请人： Shree K. Nayar ,  Tomoo Mitsunaga

发明人： Shree K. Nayar ,  Tomoo Mitsunaga

IPC分类号： H04N5/235

CPC分类号： H04N5/2355 ,  H04N5/235

摘要： Apparatus and methods are provided for obtaining high dynamic range images using a low dynamic range image sensor. The scene is exposed to the image sensor in a spatially varying manner. A variable-transmittance mask, which is interposed between the scene and the image sensor, imposes a spatially varying attenuation on the scene light incident on the image sensor. The mask includes light transmitting cells whose transmittance is controlled by application of suitable control signals. The mask is configured to generate a spatially varying light attenuation pattern across the image sensor. The image frame sensed by the image sensor is normalized with respect to the spatially varying light attenuation pattern. The normalized image data can be interpolated to account for image sensor pixels that are either under or over exposed to enhance the dynamic range of the image sensor.

摘要翻译： 提供了使用低动态范围图像传感器获得高动态范围图像的装置和方法。 场景以空间变化的方式暴露于图像传感器。 介于场景和图像传感器之间的可变透射掩模对入射在图像传感器上的场景光强加空间变化的衰减。 掩模包括通过施加适当的控制信号来控制透光率的透光单元。 掩模被配置为在图像传感器上产生空间变化的光衰减图案。 由图像传感器感测的图像帧相对于空间变化的光衰减图案被归一化。 可以对归一化图像数据进行内插，以考虑到暴露于或超过曝光的图像传感器像素，以增强图像传感器的动态范围。

公开(公告)号：US20110050934A1

公开(公告)日：2011-03-03

申请号：US12530251

申请日：2009-01-23

申请人： Tomoo Mitsunaga

发明人： Tomoo Mitsunaga

IPC分类号： H04N5/228

CPC分类号： H04N1/6027 ,  G06T5/002 ,  G06T5/40 ,  G06T2207/20012 ,  G06T2207/20021 ,  G06T2207/20192 ,  H04N1/58 ,  H04N1/6005

摘要： This invention relates to an image processing apparatus for performing edge preserving smoothing with fewer operations, and a method and a program for the same. A block histogram calculating part 113 calculates the number of pixels belonging to each luminance block as a block histogram for each luminance block obtained by dividing a luminance image in the space direction and in the luminance direction. Block integration value calculation part 115 calculates an integration value for luminance value for the pixels belonging to the luminance block as a block integration value for each luminance block. Weighted sum of product part 117 calculates a general luminance value indicating an average luminance in an object field to which the pixel subject to processing belongs from the block integration value, block histogram and the luminance value for the processing subject pixel for the luminance image. This invention can be applied to a digital video camera.

摘要翻译： 本发明涉及一种用于以更少的操作执行边缘保持平滑的图像处理装置，以及用于其的方法和程序。 块直方图计算部113将属于每个亮度块的像素数作为通过在空间方向和亮度方向上分割亮度图像获得的每个亮度块的块直方图来计算。 块积分值计算部115计算属于亮度块的像素的亮度值的积分值作为每个亮度块的块积分值。 乘积部117的加权和根据块积分值，块直方图以及亮度图像的处理对象像素的亮度值，计算表示被处理对象的像素所属的物体的平均亮度的一般亮度值。 本发明可应用于数字摄像机。