公开(公告)号：US20130070121A1

公开(公告)日：2013-03-21

申请号：US13504905

申请日：2010-10-28

申请人： Jinwei Gu ,  Yasunobu Hitomi ,  Tomoo Mitsunaga ,  Shree K. Nayar

发明人： Jinwei Gu ,  Yasunobu Hitomi ,  Tomoo Mitsunaga ,  Shree K. Nayar

IPC分类号： H04N7/00

CPC分类号： H04N7/002 ,  G06T5/003 ,  G06T2207/20201 ,  H04N5/2329 ,  H04N5/2353 ,  H04N5/3532 ,  H04N5/3535 ,  H04N5/35554 ,  H04N5/374 ,  H04N5/378 ,  H04N7/00

摘要： Methods and systems for coded rolling shutter are provided. In accordance with some embodiments, methods and system are provided that control the readout timing and exposure length for each row of a pixel array in an image sensor, thereby flexibly sampling the three-dimensional space-time value of a scene and capturing sub-images that effectively encode motion and dynamic range information within a single captured image.

公开(公告)号：US20120287294A1

公开(公告)日：2012-11-15

申请号：US13457774

申请日：2012-04-27

申请人： Shun Kaizu ,  Tomoo Mitsunaga ,  Yasushi Saito ,  Masanori Kasai

发明人： Shun Kaizu ,  Tomoo Mitsunaga ,  Yasushi Saito ,  Masanori Kasai

IPC分类号： H04N5/235

CPC分类号： H04N5/2353 ,  H04N5/2355 ,  H04N5/35554 ,  H04N5/35581 ,  H04N5/3559

摘要： There is provided an image processing apparatus including an HDR (High Dynamic Range) processing unit inputting images picked up while exposure control that changes an exposure time is being carried out with a predetermined spatial period and a predetermined temporal period on pixels that compose an image sensor, and carrying out image processing. The HDR processing unit generates a first combined image by combining pixel values of a plurality of images with different sensitivities generated by an interpolation process using a plurality of consecutively picked-up images, generates a second combined image by combining pixel values of a plurality of images with different sensitivities generated by an interpolation process that uses a single picked-up image, and generates an HDR image by executing a pixel value blending process on the first combined image and the second combined image in accordance with a blending ratio calculated in accordance with movement detection information.

摘要翻译： 提供了一种图像处理装置，其包括HDR（高动态范围）处理单元，其输入在组合图像传感器的像素上以预定空间周期和预定时间周期改变曝光时间的曝光控制的拍摄图像 并执行图像处理。 HDR处理单元通过将通过使用多个连续拍摄图像的内插处理生成的不同灵敏度的多个图像的像素值组合来生成第一组合图像，通过组合多个图像的像素值来生成第二组合图像 具有由使用单个拾取图像的内插处理产生的不同灵敏度，并且通过根据根据移动计算的混合比率对第一组合图像和第二组合图像执行像素值混合处理来生成HDR图像 检测信息。

公开(公告)号：US20120250993A1

公开(公告)日：2012-10-04

申请号：US13425155

申请日：2012-03-20

申请人： Daisuke ISO ,  Tappei Kurita ,  Tomoo Mitsunaga

发明人： Daisuke ISO ,  Tappei Kurita ,  Tomoo Mitsunaga

IPC分类号： G06K9/40

CPC分类号： G06T5/001 ,  G06T3/4015 ,  G06T5/002 ,  G06T5/003 ,  G06T5/004 ,  G06T5/005 ,  G06T2200/12

摘要： An image processing device includes an image estimation unit that estimates an image prior to the jaggedness occurrence from a jaggedness-occurring image and generates an estimated image prior to the jaggedness occurrence, and a weighting/adding unit that selects a jaggedness-occurring area as a processing target area in the estimated image prior to the jaggedness occurrence, detects a similar area that is a pixel area and similar to the processing target area, and then computes a weight according to the degree of similarity of each detected similar area to the processing target area, and detects a corresponding area in the jaggedness-occurring image to the processing target area and the similar area, and then computes a corrected pixel value of the processing target area of the jaggedness-occurring image through a weighting/adding process to which the weight of a pixel value of the detected corresponding area is applied.

摘要翻译： 图像处理装置包括图像估计单元，其从锯齿状发生图像估计出锯齿状发生之前的图像，并且在锯齿状发生之前生成估计图像;以及加权/相加单元，其选择锯齿状发生区域作为 在锯齿状发生之前的估计图像中处理目标区域检测与像处理目标区域相似的像素区域的类似区域，然后根据每个检测到的类似区域与处理目标的相似程度来计算权重 并且将锯齿状发生图像中的对应区域检测到处理目标区域和类似区域，然后通过加权/添加处理来计算锯齿状图像的处理目标区域的校正像素值， 应用检测到的对应区域的像素值的权重。

公开(公告)号：US08233733B2

公开(公告)日：2012-07-31

申请号：US12057189

申请日：2008-03-27

申请人： Fumihito Yasuma ,  Tomoo Mitsunaga

发明人： Fumihito Yasuma ,  Tomoo Mitsunaga

IPC分类号： G06K9/40

CPC分类号： H04N9/045 ,  G06T3/4015

摘要： An image processing device includes: a first smoothing unit calculating, regarding multiple positions along a first direction in a neighbor region of a predetermined pixel of interest in an input image, a first-stage smoothing value wherein pixel values have been smoothed along a second direction differing from the first, for a first channel; a second smoothing unit calculating, regarding multiple positions along the first direction in the neighbor region, a first-stage smoothing value wherein pixel values have been smoothed along the second direction, for a second channel; an intensity estimating unit estimating the intensity of the first-stage smoothing value of the second channel, based on the first-stage smoothing values of the first and second channels; and a third smoothing unit calculating a second-stage smoothing value for the second channel, the first-stage smoothing value of the second channel intensity-estimated by the intensity estimating unit having been smoothed along the first direction.

摘要翻译： 一种图像处理装置包括：第一平滑单元，计算关于在输入图像中的感兴趣的预定像素的相邻区域中沿着第一方向的多个位置的第一平滑值，其中像素值沿着第二方向被平滑 与第一个渠道不同; 第二平滑单元计算关于相邻区域中沿着第一方向的多个位置的第一平滑值，其中像素值已经沿着第二方向被平滑，对于第二通道; 强度估计单元，基于第一和第二信道的第一级平滑值估计第二信道的第一级平滑值的强度; 以及计算第二通道的第二级平滑值的第三平滑单元，由强度估计单元估计的第二通道强度的第一级平滑值沿着第一方向被平滑化。

公开(公告)号：US07999858B2

公开(公告)日：2011-08-16

申请号：US10959679

申请日：2004-10-05

申请人： Shree K. Nayar ,  Tomoo Mitsunaga

发明人： Shree K. Nayar ,  Tomoo Mitsunaga

IPC分类号： H04N5/228

CPC分类号： H04N5/235 ,  H04N5/35563

摘要： The application provides techniques for obtaining a relatively high dynamic range image of a scene using a relatively low dynamic range image sensor exposed to incident light from the scene for capturing an image. The image sensor has a multiplicity of light-sensing elements in an array and each light sensing element has a particular one of a plurality of sensitivity levels to incident light in accordance with a predetermined sensitivity pattern for the array of light-sensing elements and has a response function. Each light sensing element is responsive to incident light from the scene for producing a captured image brightness value at a corresponding one of a multiplicity of pixel positions of a pixel position array. Each one of the multiplicity of pixel positions corresponds to a particular one of the plurality of sensitivity levels of the light sensing elements.

摘要翻译： 该应用提供了使用暴露于来自场景的入射光以捕获图像的相对低的动态范围图像传感器来获得场景的相对高的动态范围图像的技术。 图像传感器具有阵列中的多个感光元件，并且每个光感测元件根据用于光感测元件阵列的预定灵敏度图案具有对入射光的多个灵敏度水平中的特定一个，并且具有 响应功能。 每个光感测元件响应来自场景的入射光，以在像素位置阵列的多个像素位置中的相应一个处产生捕获的图像亮度值。 多个像素位置中的每一个对应于光感测元件的多个灵敏度级别中的特定一个。

公开(公告)号：US20110150356A1

公开(公告)日：2011-06-23

申请号：US12967801

申请日：2010-12-14

申请人： Kensei JO ,  Yoshikuni Nomura ,  Tomoo Mitsunaga

发明人： Kensei JO ,  Yoshikuni Nomura ,  Tomoo Mitsunaga

IPC分类号： G06K9/44

CPC分类号： G06T5/007 ,  G06T5/002 ,  G06T2207/10024 ,  G06T2207/20021 ,  G06T2207/20192

摘要： An image processing apparatus includes: a characteristic value calculation unit calculating a block luminance average value, which is an average value of luminance values in each of spatial blocks obtained by dividing an input image in a space direction, and a block luminance dispersion, which is a dispersion of the luminance values in each of the spatial blocks; and an edge-preserving smoothing unit calculating a general luminance value of pixels of the input image by setting a value obtained by approximately calculating a weighted average value of the luminance values of a noticed block containing noticed pixels of the input image, on the assumption that a distribution of the luminance values of each of the spatial blocks conforms to a Gaussian distribution based on the block luminance average value and the block luminance dispersion of each of the spatial blocks, as the general luminance value of the noticed pixels.

摘要翻译： 图像处理装置包括：特征值计算单元，计算作为在空间方向上划分输入图像而获得的每个空间块中的亮度值的平均值和块亮度色散的块亮度平均值， 亮度值在每个空间块中的色散; 以及边缘保持平滑单元，通过设置通过近似计算包含输入图像的注意像素的注意块的亮度值的加权平均值而获得的值来计算输入图像的像素的一般亮度值，假设 每个空间块的亮度值的分布与基于块亮度平均值和每个空间块的块亮度色散的高斯分布一致，作为注意像素的一般亮度值。

公开(公告)号：US07719573B2

公开(公告)日：2010-05-18

申请号：US10148838

申请日：2001-10-03

申请人： Kouichi Harada ,  Tomoo Mitsunaga ,  Seiji Kobayashi

发明人： Kouichi Harada ,  Tomoo Mitsunaga ,  Seiji Kobayashi

IPC分类号： H04N5/235 ,  G03B7/00

CPC分类号： H01L27/1485 ,  H01L27/1462 ,  H01L27/14812 ,  H04N5/235 ,  H04N5/35554 ,  H04N5/3728

摘要： Disclosed herein is a photographing device that includes a number of light-receiving elements, a number of vertical transfer registers, a first drive-voltage applying electrode, and a second drive-voltage applying electrode. The light-receiving elements are arranged in a horizontal direction and a vertical direction. The vertical transfer registers transfers the electric charges accumulated in the light-receiving elements in the vertical direction. The first drive-voltage applying electrode is arranged parallel to the vertical transfer registers, for applying a drive voltage to a specific one of the vertical transfer registers. The second drive-voltage applying electrode is arranged perpendicular to the vertical transfer registers, for applying a second drive voltage to the vertical transfer registers at the same time. The electric charges accumulated in the light-receiving elements are transferred to the vertical transfer registers, due to the voltage output from the first drive-voltage applying electrode or the second drive-voltage applying electrode, or the voltages output from both electrodes. Therefore, the light-receiving elements can have different sensitivities, and the photographing device can photograph dynamic scenes in a broad dynamic range.

摘要翻译： 本文公开了一种拍摄装置，其包括多个光接收元件，多个垂直传送寄存器，第一驱动电压施加电极和第二驱动电压施加电极。 光接收元件沿水平方向和垂直方向排列。 垂直传送寄存器在垂直方向上传送累积在光接收元件中的电荷。 第一驱动电压施加电极平行于垂直传送寄存器布置，用于将驱动电压施加到特定的一个垂直传送寄存器。 第二驱动电压施加电极垂直于垂直传送寄存器布置，用于将第二驱动电压同时施加到垂直传送寄存器。 由于从第一驱动电压施加电极或第二驱动电压施加电极输出的电压或从两个电极输出的电压，累积在光接收元件中的电荷被传送到垂直传送寄存器。 因此，光接收元件可以具有不同的灵敏度，并且拍摄装置可以在宽动态范围内拍摄动态场景。

公开(公告)号：US20100091147A1

公开(公告)日：2010-04-15

申请号：US12586000

申请日：2009-09-30

申请人： Yoshikuni Nomura ,  Tomoo Mitsunaga

发明人： Yoshikuni Nomura ,  Tomoo Mitsunaga

IPC分类号： H04N5/335

CPC分类号： F21V9/08 ,  H01L27/146 ,  H04N9/045

摘要： A color filter array includes a plurality of filters, each having one of a plurality of types of spectral sensitivity and being disposed at the location of a corresponding one of a plurality of pixels. The filters of a predetermined type selected from among the plurality of types are arranged at the locations of the pixels in a checkered pattern, and the filters of some or all of the other types are randomly arranged at the pixel locations at which the filters of the predetermined type are not present.

公开(公告)号：US20080267526A1

公开(公告)日：2008-10-30

申请号：US12112778

申请日：2008-04-30

申请人： Tomoo Mitsunaga ,  Seiji Kobayashi ,  Hiroaki Ono

发明人： Tomoo Mitsunaga ,  Seiji Kobayashi ,  Hiroaki Ono

IPC分类号： G06K9/40

CPC分类号： H04N5/35563 ,  H04N5/3651 ,  H04N5/367 ,  H04N5/372 ,  H04N9/045

摘要： The present invention relates to an image processing apparatus which can restore, from a color and sensitivity mosaic image acquired using a CCD image sensor of the single plate type or the like, a color image signal of a wide dynamic range wherein the sensitivity characteristics of pixels are uniformized and each of the pixels has all of a plurality of color components. A sensitivity uniformization section uniformizes the sensitivities of pixels of a color and sensitivity mosaic image to produce a color mosaic image, and a color interpolation section interpolates color components of the pixels of the color mosaic image M to produce output images R, G and B. The present invention can be applied to a digital camera which converts a picked up optical image into a color image signal of a wide dynamic range.

摘要翻译： 本发明涉及一种图像处理装置，该图像处理装置可以从采用单板类型的CCD图像传感器等获取的颜色和感光度马赛克图像中恢复宽动态范围的彩色图像信号，其中像素的灵敏度特性 均匀化，并且每个像素具有所有多个颜色分量。 灵敏度均匀化部分使颜色和灵敏度马赛克图像的像素的灵敏度均匀化，以产生彩色马赛克图像，并且颜色插值部分插值彩色马赛克图像M的像素的颜色分量以产生输出图像R，G和B. 本发明可以应用于将拾取的光学图像转换成宽动态范围的彩色图像信号的数字照相机。

公开(公告)号：US07412092B2

公开(公告)日：2008-08-12

申请号：US10974507

申请日：2004-10-27

申请人： Yoshikuni Nomura ,  Tomoo Mitsunaga

发明人： Yoshikuni Nomura ,  Tomoo Mitsunaga

IPC分类号： G06K9/00

CPC分类号： H04N9/045

摘要： A texture-intensity computation section computes a texture intensity TH and a texture intensity TV using interpolation values GA and EA. A G interpolation section computes an interpolation value GF using a horizontally adjacent interpolation value GA and a signal R. An E interpolation section computes an interpolation value EF using a vertically adjacent interpolation value EA and the signal R. The G interpolation section computes an interpolation value GU using the interpolation values GA, EA, and EF. The E interpolation section computes an interpolation value EU using the interpolation values GA, EA, and GF. A G+E generation section combines the interpolation values GU and EF to compute (G+E)V. A G+E generation section combines the interpolation values GF and EU to compute (G+E)H. A combining section determines the signal G+E using (G+E)H and (G+E)V, the texture intensities TH and TV.

摘要翻译： 纹理强度计算部分使用内插值GA和EA计算纹理强度T H H和纹理强度T SUB。 AG插值部分使用水平相邻的内插值GA和信号R来计算内插值GF.E内插部分使用垂直相邻的内插值EA和信号R来计算内插值EF .G内插部分计算内插值GU 使用插值GA，EA和EF。 E插值部分使用内插值GA，EA和GF计算内插值EU。 G + E生成部分组合内插值GU和EF以计算（G + E）。 G + E生成部分组合内插值GF和EU来计算（G + E）H H。 组合部分使用（G + E）H H和（G + E）V N确定信号G + E，纹理强度T H 和T V。