公开(公告)号：US08605168B2

公开(公告)日：2013-12-10

申请号：US13362304

申请日：2012-01-31

申请人： Yusuke Okada ,  Sanzo Ugawa ,  Takeo Azuma ,  Taro Imagawa

发明人： Yusuke Okada ,  Sanzo Ugawa ,  Takeo Azuma ,  Taro Imagawa

IPC分类号： H04N9/73

CPC分类号： H04N9/045 ,  H04N5/23232 ,  H04N5/3537 ,  H04N5/35509

摘要： An image capture device according to the embodiment of the present invention includes an image capture section 20 for reading a pixel signal of a first color component at a low frame rate and reading a pixel signal of a second color component at a high frame rate, and a frame rate correction section 22. The image capture section 20 performs non-destructive read of the pixel signal of the first color component in synchronization with the timing at which the pixel signal of the second color component is read during a charge accumulation time period defined by the first frame rate.

摘要翻译： 根据本发明的实施例的图像捕获装置包括：图像捕获部分20，用于以低帧速率读取第一颜色分量的像素信号，并以高帧速率读取第二颜色分量的像素信号;以及 帧速率校正部分22.图像捕获部分20与在定义的电荷累积时间段期间读取第二颜色分量的像素信号的定时同步地执行第一颜色分量的像素信号的非破坏性读取 按第一帧速率。

公开(公告)号：US08570421B2

公开(公告)日：2013-10-29

申请号：US13478628

申请日：2012-05-23

申请人： Yusuke Okada ,  Takeo Azuma ,  Sanzo Ugawa ,  Taro Imagawa

发明人： Yusuke Okada ,  Takeo Azuma ,  Sanzo Ugawa ,  Taro Imagawa

IPC分类号： H04N3/14 ,  H04N5/335 ,  H04N5/228 ,  H04N9/07 ,  H04N9/04 ,  H01L27/00

CPC分类号： H04N5/3728 ,  G06T3/4015 ,  H04N5/347 ,  H04N9/045

摘要： In one embodiment, an image sensor includes, a bank 301 of charge-coupled devices, and charge sensing amplifiers 302, each of which transforms electric charges extracted from an associated pixel into an electrical signal. After the electric charges accumulated in every pixel have been extracted to the charge-coupled devices 301 at the same time, a color component with a high resolution is output to a horizontal transfer path 316 via the charge sensing amplifiers 302 and then output to a device outside of the image sensor. Thereafter, pixel signals representing another low-resolution color component are vertically added together on the bank 301 of charge-coupled devices. Those pixel signals are horizontally added together on the horizontal transfer path 316 and output. The image obtained by this image sensor is then input to an image processing section, thereby obtaining an output color image with a high resolution and a high frame rate.

摘要翻译： 在一个实施例中，图像传感器包括电荷耦合器件的存储体301和电荷感测放大器302，每个电荷感测放大器302将从相关像素提取的电荷转换为电信号。 在每个像素中累积的电荷已经同时提取到电荷耦合器件301之后，具有高分辨率的色彩分量经由电荷感测放大器302输出到水平传输路径316，然后输出到器件 在图像传感器外面。 此后，代表另一低分辨率颜色分量的像素信号在电荷耦合器件的组301上垂直相加。 这些像素信号在水平传送路径316上水平相加在一起并输出。 然后将由该图像传感器获得的图像输入到图像处理部分，从而获得具有高分辨率和高帧率的输出彩色图像。

公开(公告)号：US20120127337A1

公开(公告)日：2012-05-24

申请号：US13362304

申请日：2012-01-31

申请人： Yusuke Okada ,  Sanzo Ugawa ,  Takeo Azuma ,  Taro Imagawa

发明人： Yusuke Okada ,  Sanzo Ugawa ,  Takeo Azuma ,  Taro Imagawa

IPC分类号： H04N9/73

CPC分类号： H04N9/045 ,  H04N5/23232 ,  H04N5/3537 ,  H04N5/35509

摘要： An image capture device according to the embodiment of the present invention includes an image capture section 20 for reading a pixel signal of a first color component at a low frame rate and reading a pixel signal of a second color component at a high frame rate, and a frame rate correction section 22. The image capture section 20 performs non-destructive read of the pixel signal of the first color component in synchronization with the timing at which the pixel signal of the second color component is read during a charge accumulation time period defined by the first frame rate.

摘要翻译： 根据本发明的实施例的图像捕获装置包括：图像捕获部分20，用于以低帧速率读取第一颜色分量的像素信号，并以高帧速率读取第二颜色分量的像素信号;以及 帧速率校正部分22.图像捕获部分20与在定义的电荷累积时间段期间读取第二颜色分量的像素信号的定时同步地执行第一颜色分量的像素信号的非破坏性读取 按第一帧速率。

公开(公告)号：US08248495B2

公开(公告)日：2012-08-21

申请号：US12517852

申请日：2008-07-25

申请人： Takeo Azuma ,  Taro Imagawa

发明人： Takeo Azuma ,  Taro Imagawa

IPC分类号： H04N9/083

CPC分类号： H04N9/045 ,  H04N5/23232 ,  H04N5/35554

摘要： An image processing device and an image processing method capable of generating a moving image having a high resolution and a high frame rate are provided by suppressing the reduction in the amount of incident light on each camera. The imaging and processing device includes a separation section for separating visible light into at least a first color component and a second color component; a first imaging section for taking a moving image of the first color component, wherein the first imaging section takes images of the moving image with a first spatial resolution and a first temporal resolution by exposure for a first charge accumulation time period; a second imaging section for taking a moving image of the second color component, wherein the second imaging section takes images of the moving image with a second spatial resolution higher than the first spatial resolution and a second temporal resolution lower than the first temporal resolution by exposure for a second charge accumulation time period longer than the first charge accumulation time period; a control section for controlling imaging conditions of the first and the second imaging sections; and a processing section for generating a moving image of the second component having the temporal and spatial resolutions thereof increased, based on information on the moving image of each of the first color component and the second color component.

摘要翻译： 通过抑制每个摄像机上的入射光量的减少，能够提供能够产生高分辨率和高帧率的运动图像的图像处理装置和图像处理方法。 该成像处理装置包括用于将可见光分离为至少第一颜色分量和第二颜色分量的分离部分; 用于拍摄第一颜色分量的运动图像的第一成像部分，其中第一成像部分通过第一电荷累积时间段的曝光以第一空间分辨率和第一时间分辨率拍摄运动图像的图像; 第二成像部分，用于拍摄第二颜色分量的运动图像，其中第二成像部分以比第一空间分辨率高的第二空间分辨率和低于第一时间分辨率的第二时间分辨率拍摄运动图像的图像 对于比第一电荷累积时间段长的第二电荷累积时间段; 用于控制第一和第二成像部分的成像条件的控制部分; 并且基于关于第一颜色分量和第二颜色分量中的每一个的运动图像的信息，生成具有时间和空间分辨率的第二分量的运动图像的处理部分增加。

公开(公告)号：US07868925B2

公开(公告)日：2011-01-11

申请号：US12530520

申请日：2008-12-18

申请人： Hideto Motomura ,  Takeo Azuma ,  Kunio Nobori ,  Taro Imagawa

发明人： Hideto Motomura ,  Takeo Azuma ,  Kunio Nobori ,  Taro Imagawa

IPC分类号： H04N5/228

CPC分类号： H04N9/045 ,  H04N5/23232 ,  H04N5/35572 ,  H04N9/09 ,  H04N2209/049

摘要： An image data generator 100 according to the present invention includes a shooting section 103, a color separating section 104, R, G and B imaging sensor sections 105, 106 and 107, an image shot storage section 108, an image shot writing section 109, a spatial frequency calculating section 186, a color channel range distribution calculating section 187, a color channel range distribution information writing section 188, a memory section 110, a shooting information reading section 111, a super-resolution section 240, an output section 114 and a line recognition signal generating section 185. This image data generator can get high-spatial-resolution, high-temporal-resolution image data with the same camera configuration as a conventional color camera and without decreasing the optical efficiency.

摘要翻译： 根据本发明的图像数据生成器100包括拍摄部分103，颜色分离部分104，R，G和B成像传感器部分105,106和107，图像拍摄存储部分108，图像拍摄写入部分109， 空间频率计算部分186，颜色通道范围分布计算部分187，颜色通道范围分布信息写入部分188，存储部分110，拍摄信息读取部分111，超分辨率部分240，输出部分114和 线识别信号生成部185.该图像数据生成器可以获得与常规彩色相机相同的相机配置的高空间分辨率，高时间分辨率图像数据，而不降低光学效率。

公开(公告)号：US20100315539A1

公开(公告)日：2010-12-16

申请号：US12517852

申请日：2008-07-25

申请人： Takeo Azuma ,  Taro Imagawa

发明人： Takeo Azuma ,  Taro Imagawa

IPC分类号： H04N9/09

CPC分类号： H04N9/045 ,  H04N5/23232 ,  H04N5/35554

摘要： An image processing device and an image processing method capable of generating a moving image having a high resolution and a high frame rate are provided by suppressing the reduction in the amount of incident light on each camera. The imaging and processing device includes a separation section for separating visible light into at least a first color component and a second color component; a first imaging section for taking a moving image of the first color component, wherein the first imaging section takes images of the moving image with a first spatial resolution and a first temporal resolution by exposure for a first charge accumulation time period; a second imaging section for taking a moving image of the second color component, wherein the second imaging section takes images of the moving image with a second spatial resolution higher than the first spatial resolution and a second temporal resolution lower than the first temporal resolution by exposure for a second charge accumulation time period longer than the first charge accumulation time period; a control section for controlling imaging conditions of the first and the second imaging sections; and a processing section for generating a moving image of the second component having the temporal and spatial resolutions thereof increased, based on information on the moving image of each of the first color component and the second color component.

摘要翻译： 通过抑制每个摄像机上的入射光量的减少，能够提供能够产生高分辨率和高帧率的运动图像的图像处理装置和图像处理方法。 该成像处理装置包括用于将可见光分离为至少第一颜色分量和第二颜色分量的分离部分; 用于拍摄第一颜色分量的运动图像的第一成像部分，其中第一成像部分通过第一电荷累积时间段的曝光以第一空间分辨率和第一时间分辨率拍摄运动图像的图像; 第二成像部分，用于拍摄第二颜色分量的运动图像，其中第二成像部分以比第一空间分辨率高的第二空间分辨率和低于第一时间分辨率的第二时间分辨率拍摄运动图像的图像 对于比第一电荷累积时间段长的第二电荷累积时间段; 用于控制第一和第二成像部分的成像条件的控制部分; 并且基于关于第一颜色分量和第二颜色分量中的每一个的运动图像的信息，生成具有时间和空间分辨率的第二分量的运动图像的处理部分增加。

公开(公告)号：US07825968B2

公开(公告)日：2010-11-02

申请号：US12517391

申请日：2008-08-29

申请人： Takeo Azuma ,  Kunio Nobori ,  Taro Imagawa ,  Katsuhiro Kanamori

发明人： Takeo Azuma ,  Kunio Nobori ,  Taro Imagawa ,  Katsuhiro Kanamori

IPC分类号： H04N5/225 ,  H04N5/228

CPC分类号： H04N9/09 ,  H04N5/23232 ,  H04N9/045

摘要： A multi-color image processor according to the present invention includes an image capturing section 101 and a signal processing section 104. The image capturing section 101 includes a color separating section 10 for separating visible radiation into at least two light rays with first- and second-color components, respectively, and first and second imagers 12 and 14 that receive the light rays with the first- and second-color components. The image capturing section 101 gets images with the first- and second-color components by making the first imager 12 decimate pixels to read, but making the second imager 14 read every pixel, on a field-by-field basis on respective arrangements of pixels of the first and second imagers 12 and 14. The signal processing section 104 includes: a motion estimating section 107 for estimating, based on the images with the second-color components, a motion in a moving picture made up of images with the second-color components and outputting motion information; an image generating section 108 for generating a synthetic image of the first-color components of respective fields based on the images with the first-color components and the motion information and outputting it as a first synthetic image with a higher spatial resolution than the images with the first-color components; and a multi-color image synthesizing section 109 for generating and outputting a multi-color moving picture with the first- and second-color components based on the first synthetic image and the images with the second-color components.

摘要翻译： 根据本发明的多色图像处理器包括图像捕获部分101和信号处理部分104.图像捕获部分101包括颜色分离部分10，用于将可见光辐射分成至少两个光线，第一和第二光 以及分别接收具有第一和第二颜色分量的光线的第一和第二成像器12和14。 图像拍摄部分101通过使第一成像器12抽取像素来读取第一和第二颜色分量，但是使得第二成像器14逐个逐个地读取每个像素上的各个像素的排列 信号处理部分104包括：运动估计部分107，用于基于具有第二颜色分量的图像估计由具有第二成像器12和14的图像组成的运动图像中的运动; 颜色分量和输出运动信息; 图像生成部分108，用于基于具有第一颜色分量和运动信息的图像来生成各个场的第一颜色分量的合成图像，并将其作为具有比具有更高的空间分辨率的第一合成图像输出， 第一色成分; 以及多色图像合成部109，用于基于第一合成图像和具有第二颜色分量的图像生成并输出具有第一和第二颜色分量的多色运动图像。

公开(公告)号：US20100103297A1

公开(公告)日：2010-04-29

申请号：US12530520

申请日：2008-12-18

申请人： Hideto Motomura ,  Takeo Azuma ,  Kunio Nobori ,  Taro Imagawa

发明人： Hideto Motomura ,  Takeo Azuma ,  Kunio Nobori ,  Taro Imagawa

IPC分类号： H04N5/335

CPC分类号： H04N9/045 ,  H04N5/23232 ,  H04N5/35572 ,  H04N9/09 ,  H04N2209/049

摘要： An image data generator 100 according to the present invention includes a shooting section 103, a color separating section 104, R, G and B imaging sensor sections 105, 106 and 107, an image shot storage section 108, an image shot writing section 109, a spatial frequency calculating section 186, a color channel range distribution calculating section 187, a color channel range distribution information writing section 188, a memory section 110, a shooting information reading section 111, a super-resolution section 240, an output section 114 and a line recognition signal generating section 185. This image data generator can get high-spatial-resolution, high-temporal-resolution image data with the same camera configuration as a conventional color camera and without decreasing the optical efficiency.

摘要翻译： 根据本发明的图像数据生成器100包括拍摄部分103，颜色分离部分104，R，G和B成像传感器部分105,106和107，图像拍摄存储部分108，图像拍摄写入部分109， 空间频率计算部分186，颜色通道范围分布计算部分187，颜色通道范围分布信息写入部分188，存储部分110，拍摄信息读取部分111，超分辨率部分240，输出部分114和 线识别信号生成部185.该图像数据生成器可以获得与常规彩色相机相同的相机配置的高空间分辨率，高时间分辨率图像数据，而不降低光学效率。

公开(公告)号：US07596177B2

公开(公告)日：2009-09-29

申请号：US11785367

申请日：2007-04-17

申请人： Taro Imagawa ,  Takeo Azuma

发明人： Taro Imagawa ,  Takeo Azuma

IPC分类号： H04N7/12 ,  G06K9/36

CPC分类号： H04N5/232 ,  G06T3/0087 ,  G06T7/246 ,  H04N5/2258 ,  H04N5/23232 ,  H04N5/247

摘要： An image generation apparatus includes an image receiving unit which receives a first video sequence including frames having a first resolution and a second video sequence including frames having a second resolution which is higher than the first resolution. Each frame of the first video sequence is obtained with a first exposure time, and each frame of the second video sequence is obtained with a second exposure time which is longer than the first exposure time. The image generation apparatus also includes an image integration unit which generates, from the first video sequence and the second video sequence, a new video sequence including frames having a resolution which is equal to or higher than the second resolution, at a frame rate which is equal to or higher than a frame rate of the first video sequence. The new video sequence is generated by reducing a difference between a value of each frame of the second video sequence and a sum of values of frames of the new video sequence which are included within an exposure period of the frame of the second video sequence.

摘要翻译： 图像生成装置包括图像接收单元，其接收包括具有第一分辨率的帧的第一视频序列和包括具有高于第一分辨率的第二分辨率的帧的第二视频序列。 以第一曝光时间获得第一视频序列的每帧，并且以比第一曝光时间长的第二曝光时间获得第二视频序列的每一帧。 图像生成装置还包括图像积分单元，其以第一视频序列和第二视频序列生成包括具有等于或高于第二分辨率的分辨率的帧的新视频序列，帧速率为 等于或高于第一视频序列的帧速率。 通过减少第二视频序列的每帧的值与包括在第二视频序列的帧的曝光周期内的新的视频序列的帧的总和之间的差异来生成新的视频序列。

公开(公告)号：US20090167909A1

公开(公告)日：2009-07-02

申请号：US12094370

申请日：2007-10-24

申请人： Taro Imagawa ,  Takeo Azuma

发明人： Taro Imagawa ,  Takeo Azuma

IPC分类号： H04N5/00

CPC分类号： G06T5/50 ,  G06T3/4053 ,  G06T2207/10016 ,  H04N5/232 ,  H04N5/23245

摘要： Provided is an image generation apparatus that generates a new video sequence from video sequences including image regions for which corresponding point detection and motion estimation cannot be performed correctly. The image generation apparatus includes: an exposure control unit (105) which controls an image capturing apparatus (10) to temporally change an exposure amount in a part of an exposure period; an image receiving unit (101) which receives the first video sequence and the second video sequence captured under the control of the exposure control unit (105); an image integration unit (104) which generates, from these video sequences, the new video sequence having a resolution equal to or higher than the second resolution, at a frame rate equal to or higher than the first video sequence, by reducing a difference between (i) a value of each frame in the second video sequence and (ii) a sum of values of frames in the new video sequence which correspond to the second exposure period for the each frame in the second video sequence. The second video sequence has higher resolution than the first video sequence, and the second video sequence has a frame exposure time period longer than the first video sequence.

摘要翻译： 提供了一种图像生成装置，其从包括不能正确执行对应的点检测和运动估计的图像区域的视频序列生成新的视频序列。 该图像生成装置包括：曝光控制单元，其控制图像捕获装置在时间上改变曝光期间的一部分中的曝光量; 图像接收单元，其接收在所述曝光控制单元（105）的控制下拍摄的所述第一视频序列和所述第二视频序列; 一种图像合成单元，其以这种视频序列生成具有等于或高于第二分辨率的分辨率的新视频序列，以等于或高于第一视频序列的帧速率， （i）第二视频序列中的每个帧的值，以及（ii）与第二视频序列中的每个帧的第二曝光周期对应的新视频序列中的帧的总和。 第二视频序列具有比第一视频序列更高的分辨率，并且第二视频序列具有比第一视频序列长的帧曝光时间段。