公开(公告)号：US07068845B2

公开(公告)日：2006-06-27

申请号：US09779139

申请日：2001-02-08

申请人： Tetsujiro Kondo ,  Hideo Nakaya ,  Tsutomu Watanabe ,  Hideki Ohtsuka ,  Yasuaki Takahashi ,  Seiji Wada ,  Takahiro Nagano ,  Koji Ohta ,  Hisakazu Shiraki

发明人： Tetsujiro Kondo ,  Hideo Nakaya ,  Tsutomu Watanabe ,  Hideki Ohtsuka ,  Yasuaki Takahashi ,  Seiji Wada ,  Takahiro Nagano ,  Koji Ohta ,  Hisakazu Shiraki

IPC分类号： G06K3/62

CPC分类号： H04N19/587 ,  H04N19/89 ,  H04N19/895

摘要： A class synthesizing circuit classifies an aimed-at data item into one of a plurality of classes specified in advance, according to a plurality of data items disposed around the aimed-at data item. A coefficient holding and class-code selection circuit stores conversion information for the aimed-at data item, for each class. An estimation-prediction calculation circuit converts the aimed-at data item to a higher-quality data item according to the conversion information. The class synthesizing circuit classifies the aimed-at data item into a different class according to whether the aimed-at data item is missing.

公开(公告)号：US06912014B2

公开(公告)日：2005-06-28

申请号：US09958394

申请日：2001-02-08

申请人： Tetsujiro Kondo ,  Hideo Nakaya ,  Tsutomu Watanabe ,  Hideki Ohtsuka ,  Yasuaki Takahashi ,  Seiji Wada ,  Takahiro Nagano ,  Koji Ohta

发明人： Tetsujiro Kondo ,  Hideo Nakaya ,  Tsutomu Watanabe ,  Hideki Ohtsuka ,  Yasuaki Takahashi ,  Seiji Wada ,  Takahiro Nagano ,  Koji Ohta

IPC分类号： H04N5/14 ,  H04N5/21 ,  H04N5/44 ,  H04N7/01 ,  H04N7/26 ,  H04N7/30 ,  H04N7/34 ,  H04N7/36 ,  H04N7/46 ,  H04N19/895

CPC分类号： H04N5/14 ,  H04N5/144 ,  H04N5/21 ,  H04N7/01 ,  H04N7/0122 ,  H04N7/0137 ,  H04N7/0145 ,  H04N19/14 ,  H04N19/149 ,  H04N19/17 ,  H04N19/182 ,  H04N19/186 ,  H04N19/503 ,  H04N19/59 ,  H04N19/593 ,  H04N19/895

摘要： An effective pixel area calculating circuit (11) detects position information indicating the position of a target pixel in a frame. A lacking pixel creating circuit (12) determines the class of the target pixel from a plurality of classes in accordance with the position information, then selects a plurality of pixels from an input image signal as a prediction tap, and carries out arithmetic processing based on conversion data obtained in advance by learning for each class and the prediction tap, thus outputting an output image signal of higher quality than the input image signal.

摘要翻译： 有效像素区域计算电路（11）检测表示帧中的目标像素的位置的位置信息。 缺少像素生成电路（12）根据位置信息从多个类确定目标像素的类别，然后从输入图像信号中选择多个像素作为预测抽头，并且基于 通过每个类别的学习和预测抽头预先获得的转换数据，从而输出比输入图像信号更高质量的输出图像信号。

公开(公告)号：US07903890B2

公开(公告)日：2011-03-08

申请号：US11722450

申请日：2005-12-21

申请人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

发明人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

IPC分类号： G06K9/46 ,  G06K9/62 ,  G06K9/40 ,  H04N11/04

CPC分类号： H04N5/23248 ,  G06T5/003 ,  G06T5/50 ,  G06T7/20 ,  G06T2207/20081 ,  G06T2207/20201 ,  H04N5/144 ,  H04N5/23254 ,  H04N5/23267

摘要： A target-pixel-setting section (31) sets a target pixel in a target image to be predicted. A motion-direction-detecting section (32) detects a motion direction corresponding to the target pixel. A pixel-value-extracting section (36) extracts from peripheral images corresponding to the target image, in order to extract a main term that mainly contains component of the target pixel in a moving object that encounters a motion blur in the peripheral images, at least pixel values of pixels in the peripheral images whose space position roughly agree with space position of the target pixel. A processing-coefficient-setting section (37a) sets a specific motion-blur-removing-processing coefficient. A pixel-value-generating section (38a) newly generates pixel values for processing from the pixel values extracted by the pixel-value-extracting section (36) corresponding to the motion direction and generates pixel values corresponding to the target pixel based on the pixel values for processing and the specific motion-blur-removing-processing coefficients. It is possible to perform a robust motion-blur-removing processing on any shifts of motion vector.

摘要翻译： 目标像素设置部分（31）设置要预测的目标图像中的目标像素。 运动方向检测部（32）检测与目标像素对应的运动方向。 像素值提取部分（36）从与目标图像相对应的外围图像中提取，以便提取主要包含在外围图像中遇到运动模糊的移动物体中的目标像素的分量的主项， 其空间位置与目标像素的空间位置大致一致的周边图像中的像素的最小像素值。 处理系数设定部（37a）设定特定的运动模糊去除处理系数。 像素值生成部（38a）根据与运动方向对应的像素值提取部（36）提取的像素值新生成用于处理的像素值，并且基于像素生成与像素值对应的像素值 处理值和具体的运动模糊去除处理系数。 可以对运动矢量的任何移动执行鲁棒的运动模糊去除处理。

公开(公告)号：US20090161976A1

公开(公告)日：2009-06-25

申请号：US12277591

申请日：2008-11-25

申请人： Hisakazu SHIRAKI ,  Tetsujiro Kondo ,  Kenji Takahashi ,  Tsutomu Watanabe ,  Takahiro Nagano ,  Yasuhiro Suto ,  Noriaki Takahashi

发明人： Hisakazu SHIRAKI ,  Tetsujiro Kondo ,  Kenji Takahashi ,  Tsutomu Watanabe ,  Takahiro Nagano ,  Yasuhiro Suto ,  Noriaki Takahashi

IPC分类号： G06K9/40 ,  G06F15/18

CPC分类号： G06T5/003 ,  G06T2207/20012 ,  G06T2207/20081

摘要： An image processing device for converting an input image into an output image whose blur is reduced more, the image processing device including: first image extracting section configured to extract a plurality of pixels composed of a pixel of the input image which pixel corresponds to a pixel of interest as a pixel to which to direct attention within the output image and predetermined pixels surrounding the pixel of the input image; first feature quantity calculating configured to calculate a first feature quantity from the plurality of pixels extracted by the first image extracting section; processing coefficient generating section; second pixel extracting section configured to extract a plurality of pixels composed of the pixel corresponding to the pixel of interest and predetermined pixels surrounding the pixel corresponding to the pixel of interest from the input image; and predicting section.

摘要翻译： 一种图像处理装置，用于将输入图像转换为模糊减少的输出图像，所述图像处理装置包括：第一图像提取部，被配置为提取由像素对应于像素的输入图像的像素组成的多个像素 感兴趣的像素，用于引导输出图像内的注意和围绕输入图像的像素的预定像素; 第一特征量计算，被配置为从由所述第一图像提取部提取的所述多个像素中计算第一特征量; 处理系数生成部; 第二像素提取部分，被配置为从输入图像中提取由与感兴趣像素相对应的像素组成的多个像素和围绕与感兴趣像素对应的像素的预定像素; 和预测部分。

公开(公告)号：US07750943B2

公开(公告)日：2010-07-06

申请号：US11793701

申请日：2005-12-21

申请人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

发明人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

IPC分类号： H04N5/232

CPC分类号： H04N5/23248 ,  H04N5/23254 ,  H04N5/23258 ,  H04N5/23277

摘要： A shooting-information-detecting section detects shooting information from an image pick-up section. A motion-detecting section detects a motion direction of an image on an overall screen based on a motion direction of the image pick-up section contained in the shooting information. A processing-region-setting section sets a processing region in at least any one of a predicted target image and a peripheral image thereof, which correspond to a target pixel in the predicted target image. A processing-coefficient-setting section sets a motion-blur-removing-processing coefficient that corresponds to the motion direction detected in the motion-detecting section. A pixel-value-generating section generates a pixel value that corresponds to the target pixel based on a pixel value of a pixel in the processing region set in the processing-region-setting section and the processing coefficient set in the processing-coefficient-setting section. Motion-blur-removing processing can be accurately performed.

摘要翻译： 拍摄信息检测部分从图像拾取部分检测拍摄信息。 运动检测部分基于包含在拍摄信息中的图像拾取部分的运动方向来检测整个屏幕上的图像的运动方向。 处理区域设定部设置与预测对象图像中的目标像素对应的预测对象图像和周边图像中的至少任一个中的处理区域。 处理系数设定部设定与运动检测部中检测到的运动方向对应的运动模糊去除处理系数。 像素值生成部基于处理区域设定部中设定的处理区域中的像素的像素值和处理系数设定中设定的处理系数，生成与目标像素对应的像素值 部分。 可以精确地进行运动模糊去除处理。

公开(公告)号：US07940993B2

公开(公告)日：2011-05-10

申请号：US11722141

申请日：2005-12-21

申请人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

发明人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

IPC分类号： G06K9/40 ,  G06K9/00 ,  H04N5/228

CPC分类号： H04N5/21 ,  H04N5/142 ,  H04N5/144

摘要： A motion-setting section (61) sets a motion amount and a motion direction for obtaining processing coefficients. A student-image-generating section (62) generates student images obtained by adding a motion blur to a teacher image not only based on the set motion amount and the set motion direction but also by changing at least one of the motion amount and motion direction in a specific ratio and student images obtained by adding no motion blur to the teacher image. A prediction-tap-extracting section (64) extracts, in order to extract a main term that mainly contains component of the target pixel, at least a pixel value of pixel in the student image whose space position roughly agrees with space position of the target pixel in the teacher image. A processing-coefficient-generating section (65) generates processing coefficients for predicting the target pixels in the teacher images from the pixel values of extracted pixels based on a relationship between the pixels thus extracted and the target pixels in the teacher images. The processing coefficients that are suitable for any motion blur removing which is robust against any shift of the motion vector can be generated through learning.

摘要翻译： 运动设定部（61）设定用于获得处理系数的运动量和运动方向。 学生图像生成部（62）生成不仅基于设定的运动量和设定的运动方向而将运动模糊添加到教师图像而获得的学生图像，而且通过改变运动量和运动方向中的至少一个 以特定比例和学生图像通过添加没有运动模糊获得的教师图像。 预测抽头部（64）为了提取主要包含目标像素的成分的主项，提取学生图像中的空间位置大致与目标的空间位置一致的像素的像素值 像素在老师的形象。 处理系数生成部（65）基于所提取的像素与教师图像中的目标像素之间的关系，从提取的像素的像素值生成用于预测教师图像中的目标像素的处理系数。 可以通过学习来产生适用于对运动矢量的任何移动而鲁棒的任何运动模糊去除的处理系数。

公开(公告)号：US08346003B2

公开(公告)日：2013-01-01

申请号：US12277591

申请日：2008-11-25

申请人： Hisakazu Shiraki ,  Tetsujiro Kondo ,  Kenji Takahashi ,  Tsutomu Watanabe ,  Takahiro Nagano ,  Yasuhiro Suto ,  Noriaki Takahashi

发明人： Hisakazu Shiraki ,  Tetsujiro Kondo ,  Kenji Takahashi ,  Tsutomu Watanabe ,  Takahiro Nagano ,  Yasuhiro Suto ,  Noriaki Takahashi

IPC分类号： G06K9/40 ,  G06K9/62

CPC分类号： G06T5/003 ,  G06T2207/20012 ,  G06T2207/20081

摘要： An image processing device for converting an input image into an output image whose blur is reduced. The image processing device includes a first image extracting section that extracts a plurality of pixels composed of a pixel of the input image corresponding to a pixel of interest in the output image and predetermined pixels surrounding the pixel of the input image. A first feature quantity calculating section calculates a first feature quantity from the plurality of pixels extracted by the first image extracting section. A second pixel extracting section extracts a plurality of pixels composed of the pixel of interest and predetermined pixels surrounding the pixel of interest from the input image. A predicting section then generates a pixel value of the pixel of interest.

摘要翻译： 一种用于将输入图像转换为模糊减小的输出图像的图像处理装置。 图像处理装置包括第一图像提取部，其提取由输出图像中的感兴趣像素对应的输入图像的像素构成的多个像素，以及围绕输入图像的像素的预定像素。 第一特征量计算部分从由第一图像提取部分提取的多个像素中计算第一特征量。 第二像素提取部分从输入图像中提取由关注像素组成的多个像素和围绕感兴趣像素的预定像素。 然后，预测部分生成感兴趣像素的像素值。

公开(公告)号：US08331713B2

公开(公告)日：2012-12-11

申请号：US12331815

申请日：2008-12-10

申请人： Hisakazu Shiraki ,  Tetsujiro Kondo ,  Kenji Takahashi ,  Tsutomu Watanabe ,  Takahiro Nagano ,  Yasuhiro Suto ,  Noriaki Takahashi

发明人： Hisakazu Shiraki ,  Tetsujiro Kondo ,  Kenji Takahashi ,  Tsutomu Watanabe ,  Takahiro Nagano ,  Yasuhiro Suto ,  Noriaki Takahashi

IPC分类号： G06K9/40 ,  G03B1/30 ,  G03B27/52 ,  G03B13/32 ,  H04N5/232

CPC分类号： G06T5/003 ,  G06T2207/20081

摘要： An image processing apparatus includes: a blur removing processing section configured to carry out a blur removing process for an input image using a plurality of blur removal coefficients for removing blur of a plurality of different blur amounts to produce a plurality of different blur removal result images; a feature detection section configured to detect a feature from each of the different blur removal result images; a blur amount class determination section configured to determine blur amount classes representative of classes of the blur amounts from the features; and a prediction processing section configured to carry out mathematic operation of pixel values of predetermined pixels of the input image and prediction coefficients learned in advance and corresponding to the blur amount classes to produce an output image from which the blur is removed.

摘要翻译： 一种图像处理装置，包括：模糊消除处理部，被配置为使用多个模糊去除系数对输入图像执行模糊消除处理，以去除多个不同模糊量的模糊，以产生多个不同的模糊去除结果图像 ; 特征检测部，被配置为从所述不同的模糊去除结果图像中的每一个检测特征; 模糊量等级确定部，被配置为确定表示来自所述特征的所述模糊量的类别的模糊量等级; 以及预测处理部，被配置为执行与所述模糊量等级相对应的所述输入图像的预定像素的像素值和预先知道的预测系数的数学运算，以产生去除了模糊的输出图像。

公开(公告)号：US07710461B2

公开(公告)日：2010-05-04

申请号：US11722436

申请日：2005-12-21

申请人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

发明人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

IPC分类号： H04N5/228 ,  G06K9/00 ,  H04N7/12

CPC分类号： G06T5/002 ,  G06T5/003 ,  G06T2207/20081 ,  G06T2207/20201 ,  H04N5/145 ,  H04N5/213 ,  H04N5/23248 ,  H04N5/23254 ,  H04N5/2327

摘要： A motion-vector-setting section (31) sets a first motion vector in units of pixel in a target image. An exposure-time-ratio-setting section (32) sets in units of image an exposure time ratio that is a ratio between a time interval of the target image and a period of exposure time. A motion-blur-amount-setting section (33) sets a motion blur amount in units of pixel based on the exposure time ratio and the first motion vector. Based on the motion amount, a processing-region-setting section (36) sets processing regions as well as a processing-coefficient-setting section (37) sets processing coefficients. A pixel-value-generating section (38) generates pixel values that correspond to the target pixel from pixel values in the processing region and the processing coefficients. A motion-blur-adding section (41) adds a motion blur to an image containing the pixel value generated based on an input second motion vector and the first motion vector. An image-moving section (42) moves the motion-blur-added image along a counter vector of the second motion vector. Any more real arbitrary viewpoint image can be generated.

摘要翻译： 运动矢量设定部（31）以目标图像中的像素为单位设定第一运动矢量。 曝光时间比设定部（32）以图像为单位设定作为目标图像的时间间隔与曝光时间的周期之间的比率的曝光时间比。 运动模糊量设定部（33）基于曝光时间比和第一运动矢量，以像素为单位设定运动模糊量。 基于运动量，处理区域设置部分（36）设置处理区域以及处理系数设置部分（37）设置处理系数。 像素值生成部（38）根据处理区域和处理系数的像素值生成与目标像素对应的像素值。 运动模糊添加部分（41）将运动模糊添加到包含基于输入的第二运动矢量和第一运动矢量生成的像素值的图像。 图像移动部分（42）沿着第二运动矢量的反向量移动运动模糊添加图像。 可以生成任何更真实的任意视点图像。

公开(公告)号：US20090161977A1

公开(公告)日：2009-06-25

申请号：US12331815

申请日：2008-12-10

申请人： Hisakazu SHIRAKI ,  Tetsujiro Kondo ,  Kenji Takahashi ,  Tsutomu Watanabe ,  Takahiro Nagano ,  Yasuhiro Suto ,  Noriaki Takahashi

发明人： Hisakazu SHIRAKI ,  Tetsujiro Kondo ,  Kenji Takahashi ,  Tsutomu Watanabe ,  Takahiro Nagano ,  Yasuhiro Suto ,  Noriaki Takahashi

IPC分类号： G06K9/03

CPC分类号： G06T5/003 ,  G06T2207/20081

摘要： An image processing apparatus includes: a blur removing processing section configured to carry out a blur removing process for an input image using a plurality of blur removal coefficients for removing blur of a plurality of different blur amounts to produce a plurality of different blur removal result images; a feature detection section configured to detect a feature from each of the different blur removal result images; a blur amount class determination section configured to determine blur amount classes representative of classes of the blur amounts from the features; and a prediction processing section configured to carry out mathematic operation of pixel values of predetermined pixels of the input image and prediction coefficients learned in advance and corresponding to the blur amount classes to produce an output image from which the blur is removed.

摘要翻译： 一种图像处理装置包括：模糊消除处理部，被配置为使用多个模糊去除系数对输入图像执行模糊去除处理，以去除多个不同模糊量的模糊，以产生多个不同的模糊去除结果图像 ; 特征检测部，被配置为从所述不同的模糊去除结果图像中的每一个检测特征; 模糊量等级确定部，被配置为确定表示来自所述特征的所述模糊量的类别的模糊量等级; 以及预测处理部，被配置为执行与所述模糊量等级相对应的所述输入图像的预定像素的像素值和预先知道的预测系数的数学运算，以产生去除了模糊的输出图像。