公开(公告)号：US20080129873A1

公开(公告)日：2008-06-05

申请号：US11722460

申请日：2005-12-21

申请人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

发明人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

IPC分类号： H04N5/14

CPC分类号： G06T5/50 ,  G06T5/003 ,  G06T7/215 ,  G06T2207/20081 ,  G06T2207/20201 ,  H04N5/145 ,  H04N5/21

摘要： A motion-vector-setting section (31) sets a motion vector in units of pixel in a target image. Based on the motion vector, a target-pixel-setting section (35) sets a target pixel for each image in plural images to be processed. A motion-blur-amount-setting section (33) sets a motion blur amount in units of pixel based on the motion vector and the exposure-time ratio set in units of image in the exposure-time-ratio-setting section (32). A processing-region-setting section (36) sets processing regions corresponding to the target pixel for each of the plural images based on the motion blur amount. A processing-coefficient-setting section (37) sets processing coefficients based on the motion blur amount. A pixel-value-generating section (38) generates motion-blur-removed pixel values that correspond to the target pixel by linear combination of pixel values corresponding to pixels in the processing region and the processing coefficients, so that they can be output from an integration section (39) as one pixel value. By utilizing any time-directional information significantly, motion-blur-removing processing can be accurately performed.

摘要翻译： 运动矢量设定部（31）以目标图像中的像素为单位设定运动矢量。 基于运动矢量，目标像素设定部（35）在多个待处理图像中设定各图像的目标像素。 运动模糊量设定部（33）基于在曝光时间比设定部（32）中以图像为单位设定的运动矢量和曝光时间比设定像素单位的运动模糊量， 。 处理区域设置部分（36）基于运动模糊量设置与多个图像中的每一个对应的目标像素的处理区域。 处理系数设定部（37）基于运动模糊量设定处理系数。 像素值生成部（38）通过与处理区域中的像素对应的像素值和处理系数的线性组合，生成与目标像素对应的运动模糊去除像素值，从而可以从 积分部分（39）作为一个像素值。 通过显着地利用任何时间方向信息，可以准确地执行移动模糊去除处理。

公开(公告)号：US20080095400A1

公开(公告)日：2008-04-24

申请号：US11793701

申请日：2005-12-21

申请人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

发明人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

IPC分类号： G06K9/00

CPC分类号： H04N5/23248 ,  H04N5/23254 ,  H04N5/23258 ,  H04N5/23277

摘要： A shooting-information-detecting section (31) detects shooting information from an image pick-up section (10). A motion-detecting section (33) detects a motion direction of an image on an overall screen based on a motion direction of the image pick-up section contained in the shooting information. A processing-region-setting section (36) sets a processing region in at least any one of a predicted target image and a peripheral image thereof, which correspond to a target pixel in the predicted target image. A processing-coefficient-setting section (37) sets a motion-blur-removing-processing coefficient that corresponds to the motion direction detected in the motion-detecting section (33). A pixel-value-generating section (38) generates a pixel value that corresponds to the target pixel based on a pixel value of a pixel in the processing region set in the processing-region-setting section (36) and the processing coefficient set in the processing-coefficient-setting section (37). Motion-blur-removing processing can be accurately performed.

摘要翻译： 拍摄信息检测部（31）从摄像部（10）检测拍摄信息。 运动检测部分（33）根据包含在拍摄信息中的图像拾取部分的运动方向来检测整个屏幕上的图像的运动方向。 处理区域设定部（36）将对应于预测目标图像中的目标像素的预测对象图像和周边图像中的至少任一个设置处理区域。 处理系数设定部（37）设定与运动检测部（33）中检测到的运动方向对应的运动模糊去除处理系数。 像素值生成部（38）基于处理区域设定部（36）中设定的处理区域中的像素的像素值和设定的处理系数，生成与目标像素对应的像素值 处理系数设定部（37）。 可以精确地进行运动模糊去除处理。

公开(公告)号：US20080075362A1

公开(公告)日：2008-03-27

申请号：US11722141

申请日：2005-12-21

申请人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

发明人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

IPC分类号： G06K9/62

CPC分类号： H04N5/21 ,  H04N5/142 ,  H04N5/144

摘要： A motion-setting section (61) sets a motion amount and a motion direction for obtaining processing coefficients. A student-image-generating section (62) generates student images obtained by adding a motion blur to a teacher image not only based on the set motion amount and the set motion direction but also by changing at least one of the motion amount and motion direction in a specific ratio and student images obtained by adding no motion blur to the teacher image. A prediction-tap-extracting section (64) extracts, in order to extract a main term that mainly contains component of the target pixel, at least a pixel value of pixel in the student image whose space position roughly agrees with space position of the target pixel in the teacher image. A processing-coefficient-generating section (65) generates processing coefficients for predicting the target pixels in the teacher images from the pixel values of extracted pixels based on a relationship between the pixels thus extracted and the target pixels in the teacher images. The processing coefficients that are suitable for any motion blur removing which is robust against any shift of the motion vector can be generated through learning.

摘要翻译： 运动设定部（61）设定用于获得处理系数的运动量和运动方向。 学生图像生成部（62）生成不仅基于设定的运动量和设定的运动方向而将运动模糊添加到教师图像而获得的学生图像，而且通过改变运动量和运动方向中的至少一个 以特定比例和学生图像通过添加没有运动模糊获得的教师图像。 预测抽头部（64）为了提取主要包含目标像素的成分的主项，提取学生图像中的空间位置大致与目标的空间位置一致的像素的像素值 像素在老师的形象。 处理系数生成部（65）基于所提取的像素与教师图像中的目标像素之间的关系，从提取的像素的像素值生成用于预测教师图像中的目标像素的处理系数。 可以通过学习来产生适用于对运动矢量的任何移动而鲁棒的任何运动模糊去除的处理系数。

公开(公告)号：US20080008356A1

公开(公告)日：2008-01-10

申请号：US11722450

申请日：2005-12-21

申请人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

发明人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

IPC分类号： G06K9/00

CPC分类号： H04N5/23248 ,  G06T5/003 ,  G06T5/50 ,  G06T7/20 ,  G06T2207/20081 ,  G06T2207/20201 ,  H04N5/144 ,  H04N5/23254 ,  H04N5/23267

摘要： A target-pixel-setting section (31) sets a target pixel in a target image to be predicted. A motion-direction-detecting section (32) detects a motion direction corresponding to the target pixel. A pixel-value-extracting section (36) extracts from peripheral images corresponding to the target image, in order to extract a main term that mainly contains component of the target pixel in a moving object that encounters a motion blur in the peripheral images, at least pixel values of pixels in the peripheral images whose space position roughly agree with space position of the target pixel. A processing-coefficient-setting section (37a) sets a specific motion-blur-removing-processing coefficient. A pixel-value-generating section (38a) newly generates pixel values for processing from the pixel values extracted by the pixel-value-extracting section (36) corresponding to the motion direction and generates pixel values corresponding to the target pixel based on the pixel values for processing and the specific motion-blur-removing-processing coefficients. It is possible to perform a robust motion-blur-removing processing on any shifts of motion vector.

摘要翻译： 目标像素设置部分（31）设置要预测的目标图像中的目标像素。 运动方向检测部（32）检测与目标像素对应的运动方向。 像素值提取部分（36）从与目标图像相对应的外围图像中提取，以便提取主要包含在外围图像中遇到运动模糊的移动物体中的目标像素的分量的主项， 其空间位置与目标像素的空间位置大致一致的周边图像中的像素的最小像素值。 处理系数设定部（37a）设定特定的运动模糊去除处理系数。 像素值生成部（38a）根据与运动方向对应的像素值提取部（36）提取的像素值，新生成用于处理的像素值，并基于该像素值生成部生成与目标像素对应的像素值 用于处理的像素值和具体的运动模糊去除处理系数。 可以对运动矢量的任何移动执行鲁棒的运动模糊去除处理。

公开(公告)号：US08391626B2

公开(公告)日：2013-03-05

申请号：US12331930

申请日：2008-12-10

申请人： Noriaki Takahashi ,  Hisakazu Shiraki ,  Takahiro Nagano ,  Yasuhiro Suto ,  Kenji Takahashi ,  Tsutomu Watanabe ,  Tetsujiro Kondo

发明人： Noriaki Takahashi ,  Hisakazu Shiraki ,  Takahiro Nagano ,  Yasuhiro Suto ,  Kenji Takahashi ,  Tsutomu Watanabe ,  Tetsujiro Kondo

IPC分类号： G06K9/40 ,  G06K9/62

CPC分类号： G06T5/003 ,  G06T2207/20081

摘要： A coefficient learning apparatus includes: a student-image generation section configured to generate a student image from the teacher image; a class classification section configured to sequentially set each of pixels in the teacher image as a pixel of interest and generate a class for the pixel of interest from the values of a plurality of specific pixels; a weight computation section configured to add up feature quantities; and a processing-coefficient generation section configured to generate a prediction coefficient on the basis of a determinant including said deterioration equation and a weighted constraint condition equation.

摘要翻译： 系数学习装置包括：学生图像生成部，被配置为从教师图像生成学生图像; 类分类部分，被配置为顺序地将教师图像中的每个像素设置为感兴趣的像素，并从多个特定像素的值生成关注像素的类; 权重计算部，被配置为相加特征量; 以及处理系数生成部，被配置为基于包括所述劣化方程和加权约束条件方程的行列式生成预测系数。

公开(公告)号：US08213496B2

公开(公告)日：2012-07-03

申请号：US11722460

申请日：2005-12-21

申请人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

发明人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

IPC分类号： H04N7/26 ,  G06K9/00 ,  G06K9/62 ,  H04N5/14

CPC分类号： G06T5/50 ,  G06T5/003 ,  G06T7/215 ,  G06T2207/20081 ,  G06T2207/20201 ,  H04N5/145 ,  H04N5/21

摘要： A motion-vector-setting section (31) sets a motion vector in units of pixel in a target image. Based on the motion vector, a target-pixel-setting section (35) sets a target pixel for each image in plural images to be processed. A motion-blur-amount-setting section (33) sets a motion blur amount in units of pixel based on the motion vector and the exposure-time ratio set in units of image in the exposure-time-ratio-setting section (32). A processing-region-setting section (36) sets processing regions corresponding to the target pixel for each of the plural images based on the motion blur amount. A processing-coefficient-setting section (37) sets processing coefficients based on the motion blur amount. A pixel-value-generating section (38) generates motion-blur-removed pixel values that correspond to the target pixel by linear combination of pixel values corresponding to pixels in the processing region and the processing coefficients, so that they can be output from an integration section (39) as one pixel value. By utilizing any time-directional information significantly, motion-blur-removing processing can be accurately performed.

摘要翻译： 运动矢量设定部（31）以目标图像中的像素为单位设定运动矢量。 基于运动矢量，目标像素设定部（35）在多个待处理图像中设定各图像的目标像素。 运动模糊量设定部（33）基于在曝光时间比设定部（32）中以图像为单位设定的运动矢量和曝光时间比设定像素单位的运动模糊量， 。 处理区域设置部分（36）基于运动模糊量设置与多个图像中的每一个对应的目标像素的处理区域。 处理系数设定部（37）基于运动模糊量设定处理系数。 像素值生成部（38）通过与处理区域中的像素对应的像素值和处理系数的线性组合，生成与目标像素对应的运动模糊去除像素值，从而可以从 积分部分（39）作为一个像素值。 通过显着地利用任何时间方向信息，可以准确地执行移动模糊去除处理。

公开(公告)号：US20090161948A1

公开(公告)日：2009-06-25

申请号：US12331930

申请日：2008-12-10

申请人： Noriaki TAKAHASHI ,  Hisakazu Shiraki ,  Takahiro Nagano ,  Yasuhiro Suto ,  Kenji Takahashi ,  Tsutomu Watanabe ,  Tetsujiro Kondo

发明人： Noriaki TAKAHASHI ,  Hisakazu Shiraki ,  Takahiro Nagano ,  Yasuhiro Suto ,  Kenji Takahashi ,  Tsutomu Watanabe ,  Tetsujiro Kondo

IPC分类号： G06K9/62

CPC分类号： G06T5/003 ,  G06T2207/20081

摘要： A coefficient learning apparatus includes: a student-image generation section configured to generate a student image from the teacher image; a class classification section configured to sequentially set each of pixels in the teacher image as a pixel of interest and generate a class for the pixel of interest from the values of a plurality of specific pixels; a weight computation section configured to add up feature quantities; and a processing-coefficient generation section configured to generate a prediction coefficient on the basis of a determinant including said deterioration equation and a weighted constraint condition equation.

摘要翻译： 系数学习装置包括：学生图像生成部，被配置为从教师图像生成学生图像; 类分类部分，被配置为顺序地将教师图像中的每个像素设置为感兴趣的像素，并从多个特定像素的值生成关注像素的类; 权重计算部，被配置为相加特征量; 以及处理系数生成部，被配置为基于包括所述劣化方程和加权约束条件方程的行列式生成预测系数。

公开(公告)号：US20080259169A1

公开(公告)日：2008-10-23

申请号：US11722436

申请日：2005-12-21

申请人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

发明人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

IPC分类号： H04N5/228 ,  H04N5/14

CPC分类号： G06T5/002 ,  G06T5/003 ,  G06T2207/20081 ,  G06T2207/20201 ,  H04N5/145 ,  H04N5/213 ,  H04N5/23248 ,  H04N5/23254 ,  H04N5/2327

摘要： A motion-vector-setting section (31) sets a first motion vector in units of pixel in a target image. An exposure-time-ratio-setting section (32) sets in units of image an exposure time ratio that is a ratio between a time interval of the target image and a period of exposure time. A motion-blur-amount-setting section (33) sets a motion blur amount in units of pixel based on the exposure time ratio and the first motion vector. Based on the motion amount, a processing-region-setting section (36) sets processing regions as well as a processing-coefficient-setting section (37) sets processing coefficients. A pixel-value-generating section (38) generates pixel values that correspond to the target pixel from pixel values in the processing region and the processing coefficients. A motion-blur-adding section (41) adds a motion blur to an image containing the pixel value generated based on an input second motion vector and the first motion vector. An image-moving section (42) moves the motion-blur-added image along a counter vector of the second motion vector. Any more real arbitrary viewpoint image can be generated.

摘要翻译： 运动矢量设定部（31）以目标图像中的像素为单位设定第一运动矢量。 曝光时间比设定部（32）以图像为单位设定作为目标图像的时间间隔与曝光时间的周期之间的比率的曝光时间比。 运动模糊量设定部（33）基于曝光时间比和第一运动矢量，以像素为单位设定运动模糊量。 基于运动量，处理区域设置部分（36）设置处理区域以及处理系数设置部分（37）设置处理系数。 像素值生成部（38）根据处理区域和处理系数的像素值生成与目标像素对应的像素值。 运动模糊添加部分（41）将运动模糊添加到包含基于输入的第二运动矢量和第一运动矢量生成的像素值的图像。 图像移动部分（42）沿着第二运动矢量的反向量移动运动模糊添加图像。 可以生成任何更真实的任意视点图像。

公开(公告)号：US06597737B1

公开(公告)日：2003-07-22

申请号：US09387994

申请日：1999-09-01

申请人： Tetsujiro Kondo ,  Yasushi Tatehira ,  Masashi Uchida ,  Nobuyuki Asakura ,  Takuo Morimura ,  Kazutaka Ando ,  Hideo Nakaya ,  Tsutomu Watanabe ,  Satoshi Inoue ,  Wataru Niitsuma

发明人： Tetsujiro Kondo ,  Yasushi Tatehira ,  Masashi Uchida ,  Nobuyuki Asakura ,  Takuo Morimura ,  Kazutaka Ando ,  Hideo Nakaya ,  Tsutomu Watanabe ,  Satoshi Inoue ,  Wataru Niitsuma

IPC分类号： H04N712

CPC分类号： H04N5/144 ,  H04N7/012 ,  H04N7/0137

摘要： A motion determining apparatus for detecting a motion of a partial picture of an input picture signal is disclosed, that comprises a first motion detecting portion for comparing a frame difference detected for the partial picture with a predetermined threshold value and determining that the partial picture has a motion when the frame difference is larger than the threshold value, a second motion detecting portion for comparing a frame difference detected for the partial picture with a predetermined threshold value, comparing a field difference detected for the partial picture with a predetermined threshold value, and determining that there is a motion of an artificial picture when the frame difference and the field difference are larger than the respective threshold values, and an output portion for forming motion determination data with determination data that is output from the first motion detecting portion and the second motion detecting portion.

摘要翻译： 公开了一种用于检测输入图像信号的部分图像的运动的运动确定装置，其包括：第一运动检测部分，用于将部分图像检测到的帧差与预定阈值进行比较，并确定部分图像具有 当帧差大于阈值时的运动;第二运动检测部分，用于将对部分图像检测的帧差与预定阈值进行比较，将对部分图像检测的场差与预定阈值进行比较，以及确定 当帧差和场差大于相应阈值时存在人造图像的运动，以及用于形成具有从第一运动检测部分输出的确定数据和第二运动的运动确定数据的输出部分 检测部。

公开(公告)号：US06201833B1

公开(公告)日：2001-03-13

申请号：US09371356

申请日：1999-08-10

申请人： Tetsujiro Kondo ,  Yasushi Tatehira ,  Masashi Uchida ,  Nobuyuki Asakura ,  Takuo Morimura ,  Kazutaka Ando ,  Hideo Nakaya ,  Tsutomu Watanabe ,  Satoshi Inoue ,  Wataru Niitsuma

发明人： Tetsujiro Kondo ,  Yasushi Tatehira ,  Masashi Uchida ,  Nobuyuki Asakura ,  Takuo Morimura ,  Kazutaka Ando ,  Hideo Nakaya ,  Tsutomu Watanabe ,  Satoshi Inoue ,  Wataru Niitsuma

IPC分类号： H04N712

CPC分类号： H04N7/0137 ,  H04N5/144 ,  H04N7/0125 ,  H04N19/10 ,  H04N19/51 ,  H04N19/593

摘要： A motion determining apparatus for detecting a motion of a partial picture of an input picture signal is disclosed, that comprises a first detecting means for detecting a frame difference of the partial picture, a second detecting means for detecting a spatial activity of the partial picture, a threshold value generating means for generating a first threshold value, a second threshold value, and a third threshold value, a comparing means having at least a first comparing portion for comparing the frame difference detected by said first detecting means with the first threshold value and a second comparing portion for comparing the frame difference detected by said first detecting means with the second threshold value, a third comparing means for comparing the spatial activity detected by said second detecting means with the third threshold value, and a motion class determining means for receiving the compared results of said first comparing portion, said second comparing portion, and said third comparing means and determining the motion of the partial picture in at least three levels.

摘要翻译： 公开了一种用于检测输入图像信号的部分图像的运动的运动确定装置，其包括用于检测部分图像的帧差的第一检测装置，用于检测部分图像的空间活动的第二检测装置， 用于产生第一阈值，第二阈值和第三阈值的阈值产生装置，具有至少第一比较部分的比较装置，用于将由所述第一检测装置检测的帧差与第一阈值进行比较;以及 第二比较部分，用于将由所述第一检测装置检测的帧差与第二阈值进行比较;第三比较装置，用于将由所述第二检测装置检测的空间活动与第三阈值进行比较;以及运动类别确定装置， 所述第一比较部分，所述第二比较部分和sa的比较结果 id第三比较装置，并在至少三个级别确定部分图像的运动。