公开(公告)号：US5887082A

公开(公告)日：1999-03-23

申请号：US561377

申请日：1995-11-21

申请人： Tomoo Mitsunaga ,  Takashi Totsuka

发明人： Tomoo Mitsunaga ,  Takashi Totsuka

IPC分类号： H04N5/262 ,  G06T5/00 ,  G06K9/48

CPC分类号： G06T7/0083 ,  G06T7/408 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/20104

摘要： An image area extracting method for extracting the desired areas from the image accurately and efficiently. The rough boundary area, in which the boundary area is roughly assigned between the desired area and areas other than the desired area, is divided into a plurality of small areas. The area extracting procedure is executed on each small area and the desired area and areas other than the desired area are detected from each small area. The boundary area mask image is formed based on the detection result and the desired area is extracted based on the boundary area mask image. Thus, the desired area can be extracted from the image accurately and efficiently.

摘要翻译： 一种用于从图像中精确高效地提取所需区域的图像区域提取方法。 将边界区域粗略地分配在期望区域和除了期望区域之外的区域的粗糙边界区域被划分为多个小区域。 在每个小区域上执行区域提取过程，并且从每个小区域检测期望的区域和除期望区域之外的区域。 基于检测结果形成边界区域掩模图像，并且基于边界区域掩模图像提取期望的区域。 因此，可以准确而有效地从图像中提取期望的面积。

公开(公告)号：US09357137B2

公开(公告)日：2016-05-31

申请号：US14238216

申请日：2012-06-29

申请人： Tomoo Mitsunaga

发明人： Tomoo Mitsunaga

IPC分类号： H04N5/238 ,  H04N5/335 ,  H04N5/235 ,  H04N5/353 ,  H04N5/355 ,  H04N5/3745 ,  H04N9/04

CPC分类号： H04N5/2353 ,  H04N5/2355 ,  H04N5/3535 ,  H04N5/35554 ,  H04N5/374 ,  H04N5/37457 ,  H04N9/045

摘要： Apparatus and method for generating a wide dynamic range image by executing a pixel value combination process of a plurality of different exposure time setting pixels. Control of a different exposure time is performed for each of a plurality of pixels of the same colors configuring a pixel block and an addition pixel value obtained by adding outputs of the plurality of pixels of the same colors of the pixel block is generated. The generation of the addition pixel value is executed by an adding unit that adds the outputs of the plurality of pixels of the same colors of the pixel block. Or, the generation of the addition pixel value is executed by a floating diffusion set in a pixel block unit and a charge output from each of the plurality of pixels of the same colors configuring the pixel block is accumulated and output in the floating diffusion.

摘要翻译： 通过执行多个不同曝光时间设定像素的像素值组合处理来生成宽动态范围图像的装置和方法。 对构成像素块的相同颜色的多个像素中的每一个进行不同的曝光时间的控制，并且生成通过添加像素块的相同颜色的多个像素的输出而获得的相加像素值。 通过将像素块的相同颜色的多个像素的输出相加的相加单元来执行相加像素值的生成。 或者，通过在像素块单元中设置的浮动扩散来执行相加像素值的生成，并且从构成像素块的相同颜色的多个像素中的每一个的电荷输出被积累并在浮动扩散中输出。

公开(公告)号：US09041856B2

公开(公告)日：2015-05-26

申请号：US13447320

申请日：2012-04-16

申请人： Teppei Kurita ,  Tomoo Mitsunaga ,  Kensei Jo ,  Shun Kaizu

发明人： Teppei Kurita ,  Tomoo Mitsunaga ,  Kensei Jo ,  Shun Kaizu

IPC分类号： G06T5/00 ,  H04N5/232 ,  H04N5/235 ,  H04N5/353 ,  G06T5/50

CPC分类号： G06T5/007 ,  G06T5/50 ,  G06T2207/10144 ,  G06T2207/20208 ,  G06T2207/20221 ,  H04N5/23254 ,  H04N5/2353 ,  H04N5/2355 ,  H04N5/3535

摘要： A moving subject detection map is generated by performing moving subject region determination based on input image information from an image capture portion, and is used to set an exposure pattern for a moving subject detected pixel region. The exposure pattern is cyclically arranged with multiple different exposure times. The exposure time for a stationary subject region is set according to the brightness of the subject. Regarding an image captured based on the exposure time control, an output image is generated by computing pixel values for a moving subject region, using pixel value combination processing that utilizes the pixel values of pixels with a plurality of different exposure times being set, and by computing pixel values for the stationary subject region by multiplying a gain according to the exposure time. This achieves the acquisition of a dynamic range image while keeping deterioration of the resolution to a minimum.

摘要翻译： 通过基于来自图像拍摄部分的输入图像信息执行移动对象区域确定来生成移动被摄体检测图，并且用于设置用于移动被摄体检测像素区域的曝光图案。 曝光图案循环布置有多个不同的曝光时间。 根据被摄体的亮度设定静止被摄体区域的曝光时间。 关于基于曝光时间控制拍摄的图像，通过使用利用具有多个不同曝光时间的像素的像素值进行设定的像素值组合处理，并且通过 通过根据曝光时间乘以增益来计算静止被摄体区域的像素值。 这实现了将分辨率降低到最小的动态范围图像的获取。

公开(公告)号：US20130329128A1

公开(公告)日：2013-12-12

申请号：US14000647

申请日：2012-01-26

申请人： Shun Kaizu ,  Tomoo Mitsunaga

发明人： Shun Kaizu ,  Tomoo Mitsunaga

IPC分类号： H04N5/235

CPC分类号： H04N5/2353 ,  H04N5/2329 ,  H04N5/2355 ,  H04N5/3532 ,  H04N5/3535 ,  H04N5/35554 ,  H04N5/374

摘要： An apparatus and a method are provided, which realize image pickup processing in which setting of an exposure time is performed in units of regions in an image pickup apparatus. An electronic shutter control unit that controls an exposure start time of an image pickup device by an electronic shutter operation and a mechanical shutter control unit that controls an exposure end time of the image pickup device by a mechanical shutter operation. The electronic shutter control unit calculates the exposure start time in units of image regions based on an exposure time individually set in units of image regions, and an operation time of the mechanical shutter in units of image regions, and controls the electronic shutter to operate at the calculated exposure start time in units of image regions. For example, the exposure time control in units of regions is executed by subtracting a mechanical shutter an exposure time from a mechanical shutter operation time in units of row blocks, for example, and calculating a reset time serving as an exposure start time as an electronic shutter operation time.

摘要翻译： 提供一种实现图像拾取处理的装置和方法，其中以图像拾取装置中的区域为单位执行曝光时间的设定。 电子快门控制单元，其通过电子快门操作来控制图像拾取装置的曝光开始时间;以及机械快门控制单元，其通过机械快门操作来控制图像拾取装置的曝光结束时间。 电子快门控制单元基于以图像区域为单位单独设置的曝光时间和以图像区域为单位的机械快门的操作时间，以图像区域为单位来计算曝光开始时间，并且控制电子快门以 以图像区域为单位的计算曝光开始时间。 例如，以区域为单位的曝光时间控制例如通过以机械快门操作时间为单位从机械快门中减去曝光时间来执行，并且计算作为曝光开始时间的复位时间作为电子 快门操作时间。

公开(公告)号：US08452122B2

公开(公告)日：2013-05-28

申请号：US12545335

申请日：2009-08-21

申请人： Yasunobu Hitomi ,  Tomoo Mitsunaga

发明人： Yasunobu Hitomi ,  Tomoo Mitsunaga

IPC分类号： G06K9/40 ,  G09G1/14 ,  G09G3/28 ,  G09G3/30 ,  G09G5/02 ,  G09G5/10 ,  G06F12/06 ,  H04N9/64 ,  H04N5/202 ,  H04N1/40

CPC分类号： G06T3/4015 ,  G06T5/001 ,  G06T2207/10016 ,  G06T2207/10024 ,  H04N1/409 ,  H04N9/045 ,  H04N2209/046

摘要： An image processing apparatus includes: an assumed deteriorated image pixel value computing unit configured to calculate a pixel value of an assumed deteriorated image, wherein deterioration of a target image configured of multiple channels is assumed, for each of the channels as an assumed deteriorated image pixel value; a pseudo target image pixel value computing unit configured to calculate, regarding a pixel of interest that is a pixel of the target image corresponding to the assumed deteriorated image, a pixel value estimated for each of the channels as a pseudo target image pixel value for each of the channels based on the pixel values of the pixel of interest, and pixels adjacent thereto; and a restored image creating unit configured to create a restored image restored from the target image based on the calculated assumed deteriorated image pixel value and the calculated pseudo target image pixel value.

摘要翻译： 一种图像处理装置包括：假设退化图像像素值计算单元，被配置为计算假设退化图像的像素值，其中假设由多个通道构成的目标图像的劣化，作为假设退化图像像素 值; 伪目标图像像素值计算单元，被配置为针对作为与所述假设退化图像相对应的目标图像的像素的关注像素计算针对每个所述通道估计的像素值作为每个所述通道的伪目标图像像素值 基于感兴趣像素的像素值和与其相邻的像素的频道; 以及恢复图像生成单元，被配置为基于所计算的假设退化图像像素值和所计算的伪目标图像像素值来创建从目标图像恢复的恢复图像。

公开(公告)号：US20130077862A1

公开(公告)日：2013-03-28

申请号：US13702767

申请日：2011-05-09

申请人： Yoshikuni Nomura ,  Tomoo Mitsunaga ,  Ting Zhang ,  Nobuyuki Matsushita

发明人： Yoshikuni Nomura ,  Tomoo Mitsunaga ,  Ting Zhang ,  Nobuyuki Matsushita

IPC分类号： G06K9/32

CPC分类号： G06K9/32 ,  G06T5/002 ,  G06T5/004 ,  G06T2207/20192 ,  G06T2207/20221 ,  H04N9/045

摘要： The present invention provides an apparatus and a method to perform an interpolation process of a color mosaic image generated through an imaging process by a single-plate color imaging element. The color mosaic image generated through the imaging process by the single-plate color imaging element is input, estimation is performed for a pixel value low frequency component and a noise high frequency component corresponding to a pixel interpolation position, and calculation for a pixel value at the pixel interpolation position is performed by applying an addition result thereof. An edge-adaptive interpolation processing unit calculates a pixel value at the pixel interpolation position by using a pixel value of a reference pixel located in an edge direction. A blend processing unit calculates a final interpolation pixel value by blending the edge-adaptive interpolation pixel value and the addition result of the pixel value low frequency component and the noise high frequency component corresponding to the pixel interpolation position in accordance with flatness at the pixel interpolation position.

摘要翻译： 本发明提供一种通过单板彩色成像元件通过成像处理产生的彩色马赛克图像的内插处理的装置和方法。 输入通过单板彩色成像元件的成像处理产生的彩色马赛克图像，对与像素插值位置对应的像素值低频分量和噪声高频分量进行估计，并计算像素值 通过应用其相加结果来执行像素插值位置。 边缘自适应插值处理单元通过使用位于边缘方向上的参考像素的像素值来计算像素插值位置处的像素值。 混合处理单元通过根据像素插值的平坦度，混合边缘自适应内插像素值和像素值低频分量的相加结果和对应于像素插值位置的噪声高频分量来计算最终内插像素值 位置。

公开(公告)号：US20120281133A1

公开(公告)日：2012-11-08

申请号：US13447320

申请日：2012-04-16

申请人： Teppei Kurita ,  Tomoo Mitsunaga ,  Kensei Jo ,  Shun Kaizu

发明人： Teppei Kurita ,  Tomoo Mitsunaga ,  Kensei Jo ,  Shun Kaizu

IPC分类号： H04N5/235

CPC分类号： G06T5/007 ,  G06T5/50 ,  G06T2207/10144 ,  G06T2207/20208 ,  G06T2207/20221 ,  H04N5/23254 ,  H04N5/2353 ,  H04N5/2355 ,  H04N5/3535

摘要： A moving subject detection map is generated by performing moving subject region determination based on input image information from an image capture portion, and is used to set an exposure pattern for a moving subject detected pixel region. The exposure pattern is cyclically arranged with multiple different exposure times. The exposure time for a stationary subject region is set according to the brightness of the subject. Regarding an image captured based on the exposure time control, an output image is generated by computing pixel values for a moving subject region, using pixel value combination processing that utilizes the pixel values of pixels with a plurality of different exposure times being set, and by computing pixel values for the stationary subject region by multiplying a gain according to the exposure time. This achieves the acquisition of a dynamic range image while keeping deterioration of the resolution to a minimum.

摘要翻译： 通过基于来自图像拍摄部分的输入图像信息执行移动对象区域确定来生成移动被摄体检测图，并且用于设置用于移动被摄体检测像素区域的曝光图案。 曝光图案循环布置有多个不同的曝光时间。 根据被摄体的亮度设定静止被摄体区域的曝光时间。 关于基于曝光时间控制拍摄的图像，通过使用利用具有多个不同曝光时间的像素的像素值进行设定的像素值组合处理，并且通过 通过根据曝光时间乘以增益来计算静止被摄体区域的像素值。 这实现了将分辨率降低到最小的动态范围图像的获取。

公开(公告)号：US20120269455A1

公开(公告)日：2012-10-25

申请号：US13442575

申请日：2012-04-09

申请人： Tomoo Mitsunaga ,  Hiroaki Takahashi

发明人： Tomoo Mitsunaga ,  Hiroaki Takahashi

IPC分类号： G06K9/40

CPC分类号： G06T3/4007 ,  G06T2207/20192

摘要： A normal-phase candidate position selection unit designates a pixel on a horizontal or vertical line in a position separated by two lines from a target position of an input image as a normal-phase candidate pixel, which is a candidate for a pixel at which jaggies are in the same phase as a pixel of the target position. A reverse-phase candidate position selection unit designates a pixel between the target position in the input image and the normal-phase candidate pixel as a reverse-phase candidate pixel. The weight value calculation unit calculates a weight value based on a degree of similarity between an image adjacent to the target position and an image adjacent to the normal-phase candidate pixel. The weighted expected value calculation unit performs weighted addition of reverse-phase candidate pixels using the weight value and generates a reverse-phase image by reversing only the phase of the jaggies in the input image.

摘要翻译： 正相候选位置选择单元将与从输入图像的目标位置分开的两行的位置的水平或垂直线上的像素指定为作为候选像素的候选像素的正常相位候选像素 与目标位置的像素处于相同的相位。 反相候选位置选择单元将输入图像中的目标位置与正相候选像素之间的像素指定为反相候选像素。 权重值计算单元基于与目标位置相邻的图像与与正常相位候选像素相邻的图像之间的相似度来计算权重值。 加权期望值计算单元使用加权值执行反相候选像素的加权相加，并且通过仅反转输入图像中的锯齿相位来产生反相图像。

公开(公告)号：US07924321B2

公开(公告)日：2011-04-12

申请号：US10886746

申请日：2004-07-07

申请人： Shree K. Nayar ,  Tomoo Mitsunaga

发明人： Shree K. Nayar ,  Tomoo Mitsunaga

IPC分类号： H04N5/235 ,  H04N9/73

CPC分类号： H04N5/2355 ,  H04N5/235

摘要： Apparatus and methods are provided for obtaining high dynamic range images using a low dynamic range image sensor. The scene is exposed to the image sensor in a spatially varying manner. A variable-transmittance mask, which is interposed between the scene and the image sensor, imposes a spatially varying attenuation on the scene light incident on the image sensor. The mask includes light transmitting cells whose transmittance is controlled by application of suitable control signals. The mask is configured to generate a spatially varying light attenuation pattern across the image sensor. The image frame sensed by the image sensor is normalized with respect to the spatially varying light attenuation pattern. The normalized image data can be interpolated to account for image sensor pixels that are either under or over exposed to enhance the dynamic range of the image sensor.

摘要翻译： 提供了使用低动态范围图像传感器获得高动态范围图像的装置和方法。 场景以空间变化的方式暴露于图像传感器。 介于场景和图像传感器之间的可变透射掩模对入射在图像传感器上的场景光强加空间变化的衰减。 掩模包括通过施加适当的控制信号来控制透光率的透光单元。 掩模被配置为在图像传感器上产生空间变化的光衰减图案。 由图像传感器感测的图像帧相对于空间变化的光衰减图案被归一化。 可以对归一化图像数据进行内插，以考虑到暴露于或超过曝光的图像传感器像素，以增强图像传感器的动态范围。

公开(公告)号：US07899266B2

公开(公告)日：2011-03-01

申请号：US11500386

申请日：2006-08-08

申请人： Tomoo Mitsunaga

发明人： Tomoo Mitsunaga

IPC分类号： G06K9/00 ,  G06K9/36 ,  G06K9/40 ,  G06K1/00 ,  G06F15/00 ,  H04N1/40 ,  H04N5/202 ,  H04N5/00 ,  G03F3/08

CPC分类号： H04N5/20 ,  H04N5/57 ,  H04N5/772 ,  H04N5/907 ,  H04N9/69

摘要： An image processing apparatus tone-compresses input luminance values representing luminance values of an input image. The image processing apparatus includes a conversion-curve calculator configured to calculate a conversion curve that is used for tone-compressing luminance values, on the basis of a distribution of the input luminance values; a global-luminance calculator configured to calculate global luminance values representing luminance values of a global-luminance image composed of low-frequency components of the input image; a tone compressor configured to tone-compress the input luminance values and the global luminance values according to the conversion curve; and a contrast corrector configured to correct contrast of a tone-compressed input image composed of the tone-compressed input luminance values, on the basis of a slope of the conversion curve and the tone-compressed global luminance values.

摘要翻译： 图像处理装置对表示输入图像的亮度值的输入亮度值进行色调压缩。 图像处理装置包括转换曲线计算器，被配置为基于输入亮度值的分布来计算用于色调压缩亮度值的转换曲线; 全局亮度计算器，被配置为计算表示由输入图像的低频分量组成的全局亮度图像的亮度值的全局亮度值; 音调压缩器，被配置为根据转换曲线对输入亮度值和全局亮度值进行色调压缩; 以及对比度校正器，被配置为基于转换曲线的斜率和色调压缩的全局亮度值来校正由色调压缩输入亮度值组成的色调压缩输入图像的对比度。