公开(公告)号：US20110170784A1

公开(公告)日：2011-07-14

申请号：US12737083

申请日：2009-03-12

申请人： Masayuki Tanaka ,  Masatoshi Okutomi ,  Yoichi Yaguchi

发明人： Masayuki Tanaka ,  Masatoshi Okutomi ,  Yoichi Yaguchi

IPC分类号： G06K9/46

CPC分类号： G06T3/4069 ,  G06T7/194 ,  G06T7/215 ,  G06T7/246 ,  G06T7/33 ,  G06T2207/10016 ,  H04N19/523 ,  H04N19/54 ,  H04N19/543

摘要： [Problem]An object of the present invention is to provide an image registration processing apparatus that is capable of performing a robust and high-accuracy registration processing with respect to an entire image between images including multiple motions.[Means for Solving the Problem]The image registration processing apparatus according to the present invention comprises a feature point extraction processing unit that extracts feature points of a basis image and an input image that include multiple motions respectively, a feature point-based registration processing unit that performs a matching processing between basis image feature points and input image feature points and an initial motion parameter estimation processing after deleting outliers from matched feature points respectively, a single-motion region extraction processing unit that extracts a single-motion region based on an initial motion parameter and by using a similarity and a local displacement between images, a region-based registration processing unit that estimates a motion parameter with subpixel accuracy based on the initial motion parameter and the single-motion region, and a feature point deletion processing unit that deletes feature points included in the single-motion region from the basis image feature points and the input image feature points.

摘要翻译： 本发明的目的是提供一种能够对包括多个运动的图像之间的整个图像执行鲁棒且高精度的注册处理的图像注册处理装置。 解决问题的手段根据本发明的图像注册处理装置包括特征点提取处理单元，其分别提取基本图像的特征点和包括多个运动的输入图像，特征点注册处理单元 在从匹配的特征点分别删除异常值之后，进行基本图像特征点和输入图像特征点之间的匹配处理以及初始运动参数估计处理，单个运动区域提取处理单元，基于初始运动区域提取单个运动区域 运动参数，并且通过使用图像之间的相似度和局部位移，基于区域的注册处理单元，其基于初始运动参数和单运动区域来估计具有子像素精度的运动参数，以及特征点删除处理单元， 删除单个中包含的功能点 - 基图像特征点和输入图像特征点的运动区域。

公开(公告)号：US20130084027A1

公开(公告)日：2013-04-04

申请号：US13578542

申请日：2011-02-10

申请人： Shunichi Koga ,  Masayuki Tanaka ,  Masatoshi Okutomi

发明人： Shunichi Koga ,  Masayuki Tanaka ,  Masatoshi Okutomi

IPC分类号： G06K9/32

CPC分类号： G06K9/32 ,  G06T3/4053 ,  H04N1/3871 ,  H04N5/232

摘要： [Problem]An object of the present invention is to provide an image processing apparatus used for acquisition assistance of optimal low-resolution image set for super-resolution processing.[Means for solving the problem]The image processing apparatus of the present invention comprises a processing unit for computing displacement amounts between a basis image and each reference image, a processing unit for generating a plurality of deformed images based on the displacement amounts, the basis image and a plurality of reference images, a processing unit for setting a threshold of a parameter used at the time of image information selection, a processing unit for selecting image information used in the super-resolution processing from the reference image by using the threshold of the parameter, a processing unit for generating composed images and weighted images based on the basis image, the displacement amounts and the image information, a processing unit for generating high-resolution grid images by dividing the composed image by the weighted image, a processing unit for generating simplified interpolation images based on high-resolution grid images, a processing unit for generating assistance images, a display unit for displaying the assistance images, and a control unit that respectively controls a processing concerning the image input, a processing concerning the basis image selection, a processing concerning the reference image selection and a processing concerning the threshold setting of the parameter as necessary.

摘要翻译： 本发明的目的是提供一种用于超分辨率处理的最佳低分辨率图像集的获取辅助的图像处理装置。 解决问题的手段本发明的图像处理装置包括：处理单元，用于计算基础图像和每个参考图像之间的位移量;处理单元，用于基于位移量产生多个变形图像;基础 图像和多个参考图像，用于设置在图像信息选择时使用的参数的阈值的处理单元，用于从参考图像中选择用于超分辨率处理的图像信息的处理单元， 所述参数，用于基于所述基础图像生成合成图像和加权图像的处理单元，所述位移量和所述图像信息，用于通过将所述合成图像除以所述加权图像来生成高分辨率网格图像的处理单元，处理单元 用于生成基于高分辨率网格图像的简化插值图像的处理单元 生成辅助图像，用于显示辅助图像的显示单元和分别控制与图像输入有关的处理的控制单元，关于基础图像选择的处理，关于参考图像选择的处理以及关于阈值设置的处理 必要的参数。

公开(公告)号：US20090207288A1

公开(公告)日：2009-08-20

申请号：US11994564

申请日：2006-06-01

申请人： Masayuki Tanaka ,  Masatoshi Okutomi

发明人： Masayuki Tanaka ,  Masatoshi Okutomi

IPC分类号： H04N5/335

CPC分类号： H04N9/045 ,  H04N5/2355 ,  H04N2209/045

摘要： The present invention provides a signal readout method of solid-state imaging device which can simultaneously readouts the signals having different properties that can generate multiple images obtained by capturing the same subject under different capturing conditions from one solid-state imaging device.A signal readout method of solid-state imaging device that is applied to a solid-state imaging device with a color filter array (CFA) and multiple pixels, the method characterized in that a pixel mixture of a different number of pixels is performed for every readout signal in the solid-state imaging device, and a signal after the pixel mixture is readout. The signal after the pixel mixture means a first signal after the pixel mixture that is obtained by performing the pixel mixture of predetermined L pixels (L≦n×m) within (n×m) pixels (n and m are natural numbers) consisting of n pixels in a vertical direction and m pixels in a horizontal direction of the solid-state imaging device, and a second signal after the pixel mixture that is obtained by down sampling pixel signals of (n×m) pixels without performing pixel mixture of (n×m) pixels.

摘要翻译： 本发明提供了一种固态成像装置的信号读出方法，其可以同时读出具有不同属性的信号，这些信号可以产生通过在不同拍摄条件下从一个固态成像装置捕获相同被摄体而获得的多个图像。 一种固态成像装置的信号读出方法，其应用于具有滤色器阵列（CFA）和多个像素的固态成像装置，该方法的特征在于，对每个像素执行不同数量的像素的像素混合 在固态成像装置中的读出信号，以及像素混合后的信号被读出。 像素混合后的信号是指在通过在（n×m）个像素（n和m是自然数）内由n个像素组成的预定的L个像素（L <= n×m）中的像素混合执行的像素混合之后的第一信号， 在固态摄像装置的水平方向上的垂直方向和m个像素以及通过对（n×m）像素的像素信号进行下采样而不执行（n×m）像素的像素混合而获得的像素混合之后的第二信号。

公开(公告)号：US08964843B2

公开(公告)日：2015-02-24

申请号：US12689395

申请日：2010-01-19

申请人： Eiji Furukawa ,  Masatoshi Okutomi ,  Masayuki Tanaka

发明人： Eiji Furukawa ,  Masatoshi Okutomi ,  Masayuki Tanaka

IPC分类号： H04N11/04 ,  H04N7/12 ,  G06K9/36 ,  G06K9/40 ,  H04N5/14 ,  H04N7/01 ,  H04N19/159 ,  G06T3/40 ,  H04N19/51 ,  H04N19/139 ,  H04N19/59 ,  H04N19/105 ,  H04N19/176 ,  H04N19/61 ,  H04N19/20 ,  H04N19/182

CPC分类号： H04N19/00218 ,  G06T3/4007 ,  H04N19/105 ,  H04N19/139 ,  H04N19/159 ,  H04N19/176 ,  H04N19/182 ,  H04N19/20 ,  H04N19/513 ,  H04N19/521 ,  H04N19/573 ,  H04N19/59 ,  H04N19/61

摘要： An image processing method includes: a frame selection step for selecting a base frame and a reference frame; an image displacement amount calculation step for calculating an image displacement amount between the reference frame and the base frame; a weighting coefficient generation step for generating a weighting coefficient using at least one of an encoding type of the reference frame and the motion information of the encoded moving image data; and an image quality improvement step for improving an image quality of the base frame using the image displacement amount calculated in the image displacement amount calculation step and the weighting coefficient generated in the weighting coefficient generation step.

摘要翻译： 一种图像处理方法包括：帧选择步骤，用于选择基本帧和参考帧; 图像位移量计算步骤，用于计算参考帧和基本帧之间的图像位移量; 加权系数生成步骤，用于使用所述参考帧的编码类型和所述编码的运动图像数据的运动信息中的至少一个来生成加权系数; 以及图像质量改进步骤，用于使用在图像位移量计算步骤中计算的图像位移量和在加权系数生成步骤中生成的加权系数来提高基本帧的图像质量。

公开(公告)号：US07932944B2

公开(公告)日：2011-04-26

申请号：US11994566

申请日：2006-06-01

申请人： Masayuki Tanaka ,  Masatoshi Okutomi

发明人： Masayuki Tanaka ,  Masatoshi Okutomi

IPC分类号： H04N9/083

CPC分类号： H04N9/045 ,  H04N2209/045

摘要： The pixel mixture method of the present invention for mixing several pixels on a solid-state image sensing device, which is applied to an imaging device having the solid-state image sensing device with a color filter array (CFA) and multiple pixels, comprising: a pixel mixture operating step for performing a pixel mixture operation based on a pixel mixture operation equation for the several pixels that are adjacent spatially; a color conversion matrix generating step for generating a color conversion matrix based on the kind of colors of a color space after mixture and the pixel mixture operation equation; and a desired color space converting step for converting the color space after mixture into a desired color space based on the generated color conversion matrix.

摘要翻译： 本发明的像素混合方法用于混合固态图像感测装置上的多个像素，其应用于具有彩色滤光器阵列（CFA）的固态图像感测装置的成像装置和多个像素，所述多个像素包括： 像素混合操作步骤，用于基于空间相邻的几个像素的像素混合运算方程执行像素混合运算; 颜色转换矩阵生成步骤，用于根据混合后的色彩空间的种类和像素混合运算方程产生颜色转换矩阵; 以及期望的颜色空间转换步骤，用于基于所生成的颜色转换矩阵将混合后的颜色空间转换成期望的颜色空间。

公开(公告)号：US20100183075A1

公开(公告)日：2010-07-22

申请号：US12689443

申请日：2010-01-19

申请人： Eiji Furukawa ,  Masatoshi Okutomi ,  Masayuki Tanaka

发明人： Eiji Furukawa ,  Masatoshi Okutomi ,  Masayuki Tanaka

IPC分类号： H04N11/02 ,  G06K9/36

CPC分类号： H04N19/58 ,  H04N19/20 ,  H04N19/44 ,  H04N19/513

摘要： An image processing method includes: a frame selection step; a motion vector calculation step for calculating a motion vector value from one frame image to another frame image by tracking each pixel of one or a plurality of frame images; and a motion vector correction step for calculating an imaginary motion vector when a motion vector that can be tracked to a tracking destination pixel corresponding to a pixel tracked up to a midway point does not exist due to an encoding type of a block including the pixel tracked up to the midway point.

摘要翻译： 一种图像处理方法包括：帧选择步骤; 运动矢量计算步骤，用于通过跟踪一个或多个帧图像的每个像素来计算从一帧图像到另一帧图像的运动矢量值; 以及运动矢量校正步骤，用于当由于包括被跟踪的像素的块的编码类型而不能存在可跟踪到跟踪到中途点的跟踪目标像素的跟踪目标像素的运动矢量时的虚拟运动矢量 直到中途点。

公开(公告)号：US20090080805A1

公开(公告)日：2009-03-26

申请号：US11666605

申请日：2005-10-17

申请人： Masayuki Tanaka ,  Masatoshi Okutomi

发明人： Masayuki Tanaka ,  Masatoshi Okutomi

IPC分类号： G06K9/32

CPC分类号： H04N1/3935 ,  G06T3/4069

摘要： A method is provided for speeding up a super-resolution processing by reducing the number of times for convolution operation that is the number of times for estimation calculation.A fast method of super-resolution processing for speeding up a super-resolution processing that estimates a high-resolution image from multiple low-resolution images with a displacement, which comprising: a first step for performing a registration of said multiple low-resolution images in a high-resolution image space and treating all pixels of said multiple low-resolution images after the registration as pixels sampled at unequal interval within said high-resolution image space; a second step for dividing said high-resolution image space into multiple small areas with a predefined size; and a third step for defining an estimated value at a predefined representative position within said small area as an estimated value of all pixels that exist within said small area for each small area divided in said second step.

摘要翻译： 提供了一种通过减少作为估计计算次数的卷积运算次数来加速超分辨率处理的方法。 一种超分辨率处理的快速方法，用于加速从具有位移的多个低分辨率图像估计高分辨率图像的超分辨率处理，其包括：第一步骤，用于执行所述多个低分辨率图像的登记 在高分辨率图像空间中，并且将所述多个低分辨率图像的所有像素处理为所述高分辨率图像空间中以不等间隔采样的像素; 用于将所述高分辨率图像空间划分成具有预定尺寸的多个小区域的第二步骤; 以及第三步骤，用于在所述小区域内的预定代表性位置处定义估计值，作为在所述第二步骤中划分的每个小区域，存在于所述小区域内的所有像素的估计值。

公开(公告)号：US09294654B2

公开(公告)日：2016-03-22

申请号：US12446760

申请日：2007-09-26

申请人： Masayuki Tanaka ,  Masatoshi Okutomi

发明人： Masayuki Tanaka ,  Masatoshi Okutomi

IPC分类号： G06K9/32 ,  H04N1/387 ,  G06T1/00 ,  G06T3/40

CPC分类号： H04N1/3871 ,  G06T1/0007 ,  G06T3/4069

摘要： The present invention provides a high-resolution image generation method which is capable of generating a high-resolution image from multiple low-resolution images having displacements without using an iterative computation.A high-resolution image generation method for generating a high-resolution image from multiple low-resolution images having displacements, comprises a first step of performing a registration processing of multiple low-resolution images; a second step of generating an average image having the undefined pixels and a weighted image based on the displacement information obtained by the registration processing and multiple low-resolution images; and a third step of generating the high-resolution image by estimating pixel values of the undefined pixels included in the average image.

摘要翻译： 本发明提供一种高分辨率图像生成方法，其能够从具有位移的多个低分辨率图像生成高分辨率图像，而不使用迭代计算。 一种用于从具有位移的多个低分辨率图像生成高分辨率图像的高分辨率图像生成方法，包括执行多个低分辨率图像的注册处理的第一步骤; 基于通过登记处理和多个低分辨率图像获得的位移信息，生成具有未定义像素的平均图像和加权图像的第二步骤; 以及第三步骤，通过估计包括在平均图像中的未定义像素的像素值来产生高分辨率图像。

公开(公告)号：US20130094781A1

公开(公告)日：2013-04-18

申请号：US13578537

申请日：2011-02-10

申请人： Shunichi Koga ,  Masayuki Tanaka ,  Masatoshi Okutomi

发明人： Shunichi Koga ,  Masayuki Tanaka ,  Masatoshi Okutomi

IPC分类号： G06T3/40

CPC分类号： G06T3/4007 ,  G06T3/4053 ,  H04N1/3871 ,  H04N1/40068 ,  H04N1/4092 ,  H04N5/23235

摘要： [Problem]An object of the present invention is to provide an image processing apparatus used for acquisition aid of optimal low-resolution image set for super-resolution processing.[Means for solving the problem]The image processing apparatus of the present invention comprises a processing unit for computing displacement amounts between a basis image and each reference image, a processing unit for generating a plurality of deformed images based on the displacement amounts, the basis image and a plurality of reference images, a processing unit for setting a threshold of a parameter used at the time of image information selection, a processing unit for selecting image information used in the super-resolution processing from the reference image by using the threshold of the parameter, a processing unit for generating composed images and weighted images based on the basis image, the displacement amounts and the image information, a processing unit for generating high-resolution grid images by dividing the composed image by the weighted image, a processing unit for generating simplified interpolation images based on high-resolution grid images, a processing unit for generating an image characteristic amount, a processing unit for displaying the image characteristic amount, and a control unit that respectively controls a processing concerning the image input, a processing concerning the basis image selection, a processing concerning the reference image selection and a processing concerning the threshold setting of the parameter as necessary.

摘要翻译： 本发明的目的是提供一种用于超分辨率处理的最佳低分辨率图像集的获取辅助的图像处理装置。 解决问题的手段本发明的图像处理装置包括：处理单元，用于计算基础图像和每个参考图像之间的位移量;处理单元，用于基于位移量产生多个变形图像;基础 图像和多个参考图像，用于设置在图像信息选择时使用的参数的阈值的处理单元，用于从参考图像中选择用于超分辨率处理的图像信息的处理单元， 所述参数，用于基于所述基础图像生成合成图像和加权图像的处理单元，所述位移量和所述图像信息，用于通过将所述合成图像除以所述加权图像来生成高分辨率网格图像的处理单元，处理单元 用于生成基于高分辨率网格图像的简化插值图像的处理单元 产生图像特征量，用于显示图像特征量的处理单元，以及分别控制与图像输入有关的处理的控制单元，关于基础图像选择的处理，关于参考图像选择的处理以及关于图像特征量的处理 根据需要设定参数的阈值。

公开(公告)号：US08873889B2

公开(公告)日：2014-10-28

申请号：US13578542

申请日：2011-02-10

申请人： Shunichi Koga ,  Masayuki Tanaka ,  Masatoshi Okutomi

发明人： Shunichi Koga ,  Masayuki Tanaka ,  Masatoshi Okutomi

IPC分类号： G06K9/32 ,  H04N5/232 ,  H04N1/387 ,  G06T3/40

CPC分类号： G06K9/32 ,  G06T3/4053 ,  H04N1/3871 ,  H04N5/232

摘要： An image processing apparatus comprises a processing unit for computing displacement amounts between a basis image and each reference image, a processing unit for generating multiple deformed images based on the displacement amounts, the basis image and multiple reference images, a processing unit for setting a threshold of a parameter, a processing unit for selecting image information from the reference image by the threshold, a processing unit for generating composed images and weighted images based on the basis image, the displacement amounts and the image information, a processing unit for generating high-resolution grid images by dividing the composed image by the weighted image, a processing unit for generating simplified interpolation images based on high-resolution grid images, a processing unit for generating assistance images, a display unit for displaying the assistance images and a control unit that controls the necessary processing as necessary.

摘要翻译： 一种图像处理装置，包括用于计算基础图像和每个参考图像之间的位移量的处理单元，用于基于所述位移量产生多个变形图像的处理单元，基础图像和多个参考图像，用于设置阈值的处理单元 参数的处理单元，用于从参考图像中选择阈值的图像信息的处理单元，用于基于基础图像，位移量和图像信息生成合成图像和加权图像的处理单元， 通过将合成图像除以加权图像的分辨率网格图像，用于基于高分辨率网格图像生成简化插值图像的处理单元，用于产生辅助图像的处理单元，用于显示辅助图像的显示单元和控制单元， 根据需要控制必要的处理。