公开(公告)号：US08213496B2

公开(公告)日：2012-07-03

申请号：US11722460

申请日：2005-12-21

申请人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

发明人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

IPC分类号： H04N7/26 ,  G06K9/00 ,  G06K9/62 ,  H04N5/14

CPC分类号： G06T5/50 ,  G06T5/003 ,  G06T7/215 ,  G06T2207/20081 ,  G06T2207/20201 ,  H04N5/145 ,  H04N5/21

摘要： A motion-vector-setting section (31) sets a motion vector in units of pixel in a target image. Based on the motion vector, a target-pixel-setting section (35) sets a target pixel for each image in plural images to be processed. A motion-blur-amount-setting section (33) sets a motion blur amount in units of pixel based on the motion vector and the exposure-time ratio set in units of image in the exposure-time-ratio-setting section (32). A processing-region-setting section (36) sets processing regions corresponding to the target pixel for each of the plural images based on the motion blur amount. A processing-coefficient-setting section (37) sets processing coefficients based on the motion blur amount. A pixel-value-generating section (38) generates motion-blur-removed pixel values that correspond to the target pixel by linear combination of pixel values corresponding to pixels in the processing region and the processing coefficients, so that they can be output from an integration section (39) as one pixel value. By utilizing any time-directional information significantly, motion-blur-removing processing can be accurately performed.

摘要翻译： 运动矢量设定部（31）以目标图像中的像素为单位设定运动矢量。 基于运动矢量，目标像素设定部（35）在多个待处理图像中设定各图像的目标像素。 运动模糊量设定部（33）基于在曝光时间比设定部（32）中以图像为单位设定的运动矢量和曝光时间比设定像素单位的运动模糊量， 。 处理区域设置部分（36）基于运动模糊量设置与多个图像中的每一个对应的目标像素的处理区域。 处理系数设定部（37）基于运动模糊量设定处理系数。 像素值生成部（38）通过与处理区域中的像素对应的像素值和处理系数的线性组合，生成与目标像素对应的运动模糊去除像素值，从而可以从 积分部分（39）作为一个像素值。 通过显着地利用任何时间方向信息，可以准确地执行移动模糊去除处理。

公开(公告)号：US20080259169A1

公开(公告)日：2008-10-23

申请号：US11722436

申请日：2005-12-21

申请人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

发明人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

IPC分类号： H04N5/228 ,  H04N5/14

CPC分类号： G06T5/002 ,  G06T5/003 ,  G06T2207/20081 ,  G06T2207/20201 ,  H04N5/145 ,  H04N5/213 ,  H04N5/23248 ,  H04N5/23254 ,  H04N5/2327

摘要： A motion-vector-setting section (31) sets a first motion vector in units of pixel in a target image. An exposure-time-ratio-setting section (32) sets in units of image an exposure time ratio that is a ratio between a time interval of the target image and a period of exposure time. A motion-blur-amount-setting section (33) sets a motion blur amount in units of pixel based on the exposure time ratio and the first motion vector. Based on the motion amount, a processing-region-setting section (36) sets processing regions as well as a processing-coefficient-setting section (37) sets processing coefficients. A pixel-value-generating section (38) generates pixel values that correspond to the target pixel from pixel values in the processing region and the processing coefficients. A motion-blur-adding section (41) adds a motion blur to an image containing the pixel value generated based on an input second motion vector and the first motion vector. An image-moving section (42) moves the motion-blur-added image along a counter vector of the second motion vector. Any more real arbitrary viewpoint image can be generated.

摘要翻译： 运动矢量设定部（31）以目标图像中的像素为单位设定第一运动矢量。 曝光时间比设定部（32）以图像为单位设定作为目标图像的时间间隔与曝光时间的周期之间的比率的曝光时间比。 运动模糊量设定部（33）基于曝光时间比和第一运动矢量，以像素为单位设定运动模糊量。 基于运动量，处理区域设置部分（36）设置处理区域以及处理系数设置部分（37）设置处理系数。 像素值生成部（38）根据处理区域和处理系数的像素值生成与目标像素对应的像素值。 运动模糊添加部分（41）将运动模糊添加到包含基于输入的第二运动矢量和第一运动矢量生成的像素值的图像。 图像移动部分（42）沿着第二运动矢量的反向量移动运动模糊添加图像。 可以生成任何更真实的任意视点图像。

公开(公告)号：US07710461B2

公开(公告)日：2010-05-04

申请号：US11722436

申请日：2005-12-21

申请人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

发明人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

IPC分类号： H04N5/228 ,  G06K9/00 ,  H04N7/12

CPC分类号： G06T5/002 ,  G06T5/003 ,  G06T2207/20081 ,  G06T2207/20201 ,  H04N5/145 ,  H04N5/213 ,  H04N5/23248 ,  H04N5/23254 ,  H04N5/2327

摘要： A motion-vector-setting section (31) sets a first motion vector in units of pixel in a target image. An exposure-time-ratio-setting section (32) sets in units of image an exposure time ratio that is a ratio between a time interval of the target image and a period of exposure time. A motion-blur-amount-setting section (33) sets a motion blur amount in units of pixel based on the exposure time ratio and the first motion vector. Based on the motion amount, a processing-region-setting section (36) sets processing regions as well as a processing-coefficient-setting section (37) sets processing coefficients. A pixel-value-generating section (38) generates pixel values that correspond to the target pixel from pixel values in the processing region and the processing coefficients. A motion-blur-adding section (41) adds a motion blur to an image containing the pixel value generated based on an input second motion vector and the first motion vector. An image-moving section (42) moves the motion-blur-added image along a counter vector of the second motion vector. Any more real arbitrary viewpoint image can be generated.

摘要翻译： 运动矢量设定部（31）以目标图像中的像素为单位设定第一运动矢量。 曝光时间比设定部（32）以图像为单位设定作为目标图像的时间间隔与曝光时间的周期之间的比率的曝光时间比。 运动模糊量设定部（33）基于曝光时间比和第一运动矢量，以像素为单位设定运动模糊量。 基于运动量，处理区域设置部分（36）设置处理区域以及处理系数设置部分（37）设置处理系数。 像素值生成部（38）根据处理区域和处理系数的像素值生成与目标像素对应的像素值。 运动模糊添加部分（41）将运动模糊添加到包含基于输入的第二运动矢量和第一运动矢量生成的像素值的图像。 图像移动部分（42）沿着第二运动矢量的反向量移动运动模糊添加图像。 可以生成任何更真实的任意视点图像。

公开(公告)号：US20080129873A1

公开(公告)日：2008-06-05

申请号：US11722460

申请日：2005-12-21

申请人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

发明人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

IPC分类号： H04N5/14

CPC分类号： G06T5/50 ,  G06T5/003 ,  G06T7/215 ,  G06T2207/20081 ,  G06T2207/20201 ,  H04N5/145 ,  H04N5/21

摘要： A motion-vector-setting section (31) sets a motion vector in units of pixel in a target image. Based on the motion vector, a target-pixel-setting section (35) sets a target pixel for each image in plural images to be processed. A motion-blur-amount-setting section (33) sets a motion blur amount in units of pixel based on the motion vector and the exposure-time ratio set in units of image in the exposure-time-ratio-setting section (32). A processing-region-setting section (36) sets processing regions corresponding to the target pixel for each of the plural images based on the motion blur amount. A processing-coefficient-setting section (37) sets processing coefficients based on the motion blur amount. A pixel-value-generating section (38) generates motion-blur-removed pixel values that correspond to the target pixel by linear combination of pixel values corresponding to pixels in the processing region and the processing coefficients, so that they can be output from an integration section (39) as one pixel value. By utilizing any time-directional information significantly, motion-blur-removing processing can be accurately performed.

摘要翻译： 运动矢量设定部（31）以目标图像中的像素为单位设定运动矢量。 基于运动矢量，目标像素设定部（35）在多个待处理图像中设定各图像的目标像素。 运动模糊量设定部（33）基于在曝光时间比设定部（32）中以图像为单位设定的运动矢量和曝光时间比设定像素单位的运动模糊量， 。 处理区域设置部分（36）基于运动模糊量设置与多个图像中的每一个对应的目标像素的处理区域。 处理系数设定部（37）基于运动模糊量设定处理系数。 像素值生成部（38）通过与处理区域中的像素对应的像素值和处理系数的线性组合，生成与目标像素对应的运动模糊去除像素值，从而可以从 积分部分（39）作为一个像素值。 通过显着地利用任何时间方向信息，可以准确地执行移动模糊去除处理。

公开(公告)号：US20080095400A1

公开(公告)日：2008-04-24

申请号：US11793701

申请日：2005-12-21

申请人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

发明人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

IPC分类号： G06K9/00

CPC分类号： H04N5/23248 ,  H04N5/23254 ,  H04N5/23258 ,  H04N5/23277

摘要： A shooting-information-detecting section (31) detects shooting information from an image pick-up section (10). A motion-detecting section (33) detects a motion direction of an image on an overall screen based on a motion direction of the image pick-up section contained in the shooting information. A processing-region-setting section (36) sets a processing region in at least any one of a predicted target image and a peripheral image thereof, which correspond to a target pixel in the predicted target image. A processing-coefficient-setting section (37) sets a motion-blur-removing-processing coefficient that corresponds to the motion direction detected in the motion-detecting section (33). A pixel-value-generating section (38) generates a pixel value that corresponds to the target pixel based on a pixel value of a pixel in the processing region set in the processing-region-setting section (36) and the processing coefficient set in the processing-coefficient-setting section (37). Motion-blur-removing processing can be accurately performed.

摘要翻译： 拍摄信息检测部（31）从摄像部（10）检测拍摄信息。 运动检测部分（33）根据包含在拍摄信息中的图像拾取部分的运动方向来检测整个屏幕上的图像的运动方向。 处理区域设定部（36）将对应于预测目标图像中的目标像素的预测对象图像和周边图像中的至少任一个设置处理区域。 处理系数设定部（37）设定与运动检测部（33）中检测到的运动方向对应的运动模糊去除处理系数。 像素值生成部（38）基于处理区域设定部（36）中设定的处理区域中的像素的像素值和设定的处理系数，生成与目标像素对应的像素值 处理系数设定部（37）。 可以精确地进行运动模糊去除处理。

公开(公告)号：US20080075362A1

公开(公告)日：2008-03-27

申请号：US11722141

申请日：2005-12-21

申请人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

发明人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

IPC分类号： G06K9/62

CPC分类号： H04N5/21 ,  H04N5/142 ,  H04N5/144

摘要： A motion-setting section (61) sets a motion amount and a motion direction for obtaining processing coefficients. A student-image-generating section (62) generates student images obtained by adding a motion blur to a teacher image not only based on the set motion amount and the set motion direction but also by changing at least one of the motion amount and motion direction in a specific ratio and student images obtained by adding no motion blur to the teacher image. A prediction-tap-extracting section (64) extracts, in order to extract a main term that mainly contains component of the target pixel, at least a pixel value of pixel in the student image whose space position roughly agrees with space position of the target pixel in the teacher image. A processing-coefficient-generating section (65) generates processing coefficients for predicting the target pixels in the teacher images from the pixel values of extracted pixels based on a relationship between the pixels thus extracted and the target pixels in the teacher images. The processing coefficients that are suitable for any motion blur removing which is robust against any shift of the motion vector can be generated through learning.

摘要翻译： 运动设定部（61）设定用于获得处理系数的运动量和运动方向。 学生图像生成部（62）生成不仅基于设定的运动量和设定的运动方向而将运动模糊添加到教师图像而获得的学生图像，而且通过改变运动量和运动方向中的至少一个 以特定比例和学生图像通过添加没有运动模糊获得的教师图像。 预测抽头部（64）为了提取主要包含目标像素的成分的主项，提取学生图像中的空间位置大致与目标的空间位置一致的像素的像素值 像素在老师的形象。 处理系数生成部（65）基于所提取的像素与教师图像中的目标像素之间的关系，从提取的像素的像素值生成用于预测教师图像中的目标像素的处理系数。 可以通过学习来产生适用于对运动矢量的任何移动而鲁棒的任何运动模糊去除的处理系数。

公开(公告)号：US20080008356A1

公开(公告)日：2008-01-10

申请号：US11722450

申请日：2005-12-21

申请人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

发明人： Takahiro Nagano ,  Tetsujiro Kondo ,  Tsutomu Watanabe ,  Junichi Ishibashi ,  Hisakazu Shiraki ,  Naoki Fujiwara ,  Masanori Kanemaru ,  Shinichiro Kaneko ,  Yasuhiro Suto

IPC分类号： G06K9/00

CPC分类号： H04N5/23248 ,  G06T5/003 ,  G06T5/50 ,  G06T7/20 ,  G06T2207/20081 ,  G06T2207/20201 ,  H04N5/144 ,  H04N5/23254 ,  H04N5/23267

摘要： A target-pixel-setting section (31) sets a target pixel in a target image to be predicted. A motion-direction-detecting section (32) detects a motion direction corresponding to the target pixel. A pixel-value-extracting section (36) extracts from peripheral images corresponding to the target image, in order to extract a main term that mainly contains component of the target pixel in a moving object that encounters a motion blur in the peripheral images, at least pixel values of pixels in the peripheral images whose space position roughly agree with space position of the target pixel. A processing-coefficient-setting section (37a) sets a specific motion-blur-removing-processing coefficient. A pixel-value-generating section (38a) newly generates pixel values for processing from the pixel values extracted by the pixel-value-extracting section (36) corresponding to the motion direction and generates pixel values corresponding to the target pixel based on the pixel values for processing and the specific motion-blur-removing-processing coefficients. It is possible to perform a robust motion-blur-removing processing on any shifts of motion vector.

摘要翻译： 目标像素设置部分（31）设置要预测的目标图像中的目标像素。 运动方向检测部（32）检测与目标像素对应的运动方向。 像素值提取部分（36）从与目标图像相对应的外围图像中提取，以便提取主要包含在外围图像中遇到运动模糊的移动物体中的目标像素的分量的主项， 其空间位置与目标像素的空间位置大致一致的周边图像中的像素的最小像素值。 处理系数设定部（37a）设定特定的运动模糊去除处理系数。 像素值生成部（38a）根据与运动方向对应的像素值提取部（36）提取的像素值，新生成用于处理的像素值，并基于该像素值生成部生成与目标像素对应的像素值 用于处理的像素值和具体的运动模糊去除处理系数。 可以对运动矢量的任何移动执行鲁棒的运动模糊去除处理。

公开(公告)号：US06658155B1

公开(公告)日：2003-12-02

申请号：US09528493

申请日：2000-03-17

申请人： Tetsujiro Kondo ,  Naoki Fujiwara ,  Kenji Takahashi ,  Naoki Kobayashi

发明人： Tetsujiro Kondo ,  Naoki Fujiwara ,  Kenji Takahashi ,  Naoki Kobayashi

IPC分类号： G06K936

CPC分类号： H04N19/98 ,  H04N19/33 ,  H04N19/593

摘要： In an upper-layer image memory, the higher four bits of an upper-layer image stored so far are updated by the use of a four-bit pixel value input from a pixel-value update circuit, and the lower four bits of the upper-layer image are updated by the use of a four-bit class code input from a class-code selection circuit.

摘要翻译： 在上层图像存储器中，通过使用从像素值更新电路输入的四位像素值来更新迄今存储的上层图像的较高的四位，并且上层图像的低四位 通过使用来自类代码选择电路的四位类代码输入来更新层图像。

公开(公告)号：US06985186B2

公开(公告)日：2006-01-10

申请号：US10112411

申请日：2002-03-28

申请人： Tetsujiro Kondo ,  Akihiko Arimitsu ,  Naoki Fujiwara ,  Yoshiaki Nakamura

发明人： Tetsujiro Kondo ,  Akihiko Arimitsu ,  Naoki Fujiwara ,  Yoshiaki Nakamura

IPC分类号： H04N7/01

CPC分类号： H04N7/0125 ,  H04N5/144 ,  H04N7/0145

摘要： A coefficient data generating apparatus includes a coefficient data generator and an estimation predictive calculation circuit. The coefficient data generator generates for each class coefficient data for an estimation expression which is used to obtain horizontal and vertical resolution corresponding to parameters input from a remote control transmitter by a user. The coefficient data is stored in a coefficient data memory. The estimation predictive calculation circuit generates based on an estimation expression HD pixel data constituting an output picture signal by using other coefficient data read from the coefficient data memory, and SD pixel data of prediction taps. The coefficient data is generated by linearly adding pieces of coefficient-generating data, and the output picture signal can be obtained so as to corresponds to the input parameters. This makes it possible to freely control the resolution of a displayed picture.

公开(公告)号：US11609327B2

公开(公告)日：2023-03-21

申请号：US16280636

申请日：2019-02-20

申请人： Keito Ando ,  Hidenori Miyazaki ,  Hoshibumi Ichiyanagi ,  Naoki Fujiwara ,  Kazuo Yamamoto

发明人： Keito Ando ,  Hidenori Miyazaki ,  Hoshibumi Ichiyanagi ,  Naoki Fujiwara ,  Kazuo Yamamoto

IPC分类号： G01S17/04 ,  G01S7/481 ,  G01S17/931 ,  G01S7/02 ,  G01S13/66 ,  G01S13/88

摘要： A target detecting device projects measuring light over a predetermined range in front of a vehicle, receives reflected light from a target, and detects the target or a distance to the target, based on a light reception signal output according to the light reception state. The light projecting unit includes a light emitting element emitting measuring light and light diffusion members. The light diffusion members are provided on an upper end portion and a lower end portion of a light projecting lens constituting part of a light projecting path, and diffuses, in the vertical direction, measuring light emitted from the light emitting element and traveling through the end portions in the vertical direction of the light traveling path while transmitting the measuring light.