公开(公告)号：US20100183075A1

公开(公告)日：2010-07-22

申请号：US12689443

申请日：2010-01-19

申请人： Eiji Furukawa ,  Masatoshi Okutomi ,  Masayuki Tanaka

发明人： Eiji Furukawa ,  Masatoshi Okutomi ,  Masayuki Tanaka

IPC分类号： H04N11/02 ,  G06K9/36

CPC分类号： H04N19/58 ,  H04N19/20 ,  H04N19/44 ,  H04N19/513

摘要： An image processing method includes: a frame selection step; a motion vector calculation step for calculating a motion vector value from one frame image to another frame image by tracking each pixel of one or a plurality of frame images; and a motion vector correction step for calculating an imaginary motion vector when a motion vector that can be tracked to a tracking destination pixel corresponding to a pixel tracked up to a midway point does not exist due to an encoding type of a block including the pixel tracked up to the midway point.

摘要翻译： 一种图像处理方法包括：帧选择步骤; 运动矢量计算步骤，用于通过跟踪一个或多个帧图像的每个像素来计算从一帧图像到另一帧图像的运动矢量值; 以及运动矢量校正步骤，用于当由于包括被跟踪的像素的块的编码类型而不能存在可跟踪到跟踪到中途点的跟踪目标像素的跟踪目标像素的运动矢量时的虚拟运动矢量 直到中途点。

公开(公告)号：US20100040304A1

公开(公告)日：2010-02-18

申请号：US12543191

申请日：2009-08-18

申请人： Masatoshi OKUTOMI ,  Masayuki TANAKA ,  Yoichi YAGUCHI ,  Soonkeun CHANG ,  Masao SHIMIZU

发明人： Masatoshi OKUTOMI ,  Masayuki TANAKA ,  Yoichi YAGUCHI ,  Soonkeun CHANG ,  Masao SHIMIZU

IPC分类号： G06K9/40

CPC分类号： G06T5/50 ,  G06T3/4053 ,  H04N1/387 ,  H04N1/40068 ,  H04N5/23232

摘要： The present invention provides an image quality improvement processing apparatus that removes occlusion regions and regions that the registration error is large, selects pixels suitable for the image quality improvement processing, and generates an image with high image quality.The image quality improvement processing apparatus of the present invention comprises a means that performs the registration processing between a basis image and an input image and generates a basis image that registration processing is already performed, a means that selects pixels used in an image quality improvement processing based on the basis image that registration processing is already performed and the input image by a predetermined condition and generates an input image that pixel selection is performed by performing an image synthesis based on a pixel selection result and the input image, a means that amends pixel values of the input image that pixel selection is performed so that luminances of pixels of the input image that pixel selection is performed become equal to luminances of corresponding pixels of the basis image that registration processing is already performed and generates an input image that pixel selection and luminance amendment are performed, and a means that performs the image quality improvement processing based on the input image that pixel selection and luminance amendment are performed and generates the image with high image quality.

摘要翻译： 本发明提供了一种图像质量改进处理装置，其去除注册误差较大的遮挡区域和区域，选择适合图像质量改善处理的像素，并生成具有高图像质量的图像。 本发明的图像质量改善处理装置包括：在基础图像和输入图像之间执行注册处理的装置，并且生成已经执行注册处理的基础图像，选择图像质量改进处理中使用的像素的装置 基于已经执行了注册处理的基础图像和预定条件的输入图像，并且通过基于像素选择结果和输入图像执行图像合成来生成执行像素选择的输入图像，修改像素的装置 执行像素选择的输入图像的值，使得执行像素选择的输入图像的像素的亮度变得等于已经执行注册处理的基本图像的对应像素的亮度，并且生成输入图像，其中像素选择和 执行亮度修正，意味着 基于执行像素选择和亮度修正的输入图像执行图像质量改进处理，并且生成具有高图像质量的图像。

公开(公告)号：US07580065B2

公开(公告)日：2009-08-25

申请号：US10572172

申请日：2005-04-12

申请人： Masao Shimizu ,  Masatoshi Okutomi

发明人： Masao Shimizu ,  Masatoshi Okutomi

IPC分类号： H04N5/262 ,  H04N5/225 ,  H04N9/04

CPC分类号： G06T3/4069

摘要： The present invention provides a movement decision method for determining direction and distance of one-dimensional movement of image capturing object or image capturing element for capturing two-dimensional sub-pixel motion image suitable for super-resolution processing, and an image capturing device using this movement decision method.while image capturing object is moved along a predetermined one-dimensional moving direction, sequential image of image capturing object is captured by fixed image capturing device, sequential image is set to two-dimensional sub-pixel motion image suitable for super-resolution processing, and one-dimensional moving direction of image capturing object in a coordinate system normalized by aspect ratio of pixel of image capturing element within image capturing device is determined to p/q of a rational number, wherein: one pixel of vertical direction of coordinate system is divided by an integer p, and one pixel of horizontal direction of coordinate system is divided by an integer q.

摘要翻译： 本发明提供了一种用于确定用于捕获适合于超分辨率处理的二维子像素运动图像的图像捕获对象或图像捕获元件的一维运动的方向和距离的运动判定方法，以及使用该方法的图像捕获装置 运动决策方法。 当图像拍摄对象沿着预定的一维移动方向移动时，图像捕获对象的顺序图像被固定图像捕获装置捕获，顺序图像被设置为适合于超分辨率处理的二维子像素运动图像，以及 将由图像拍摄装置内的图像拍摄元件的像素的高宽比归一化的坐标系中的图像拍摄对象的一维移动方向确定为有理数的p / q，其中：分割坐标系的垂直方向的一个像素 乘以整数p，将坐标系的水平方向的一个像素除以整数q。

公开(公告)号：US20090169052A1

公开(公告)日：2009-07-02

申请号：US11659911

申请日：2005-08-11

申请人： Akihito Seki ,  Masatoshi Okutomi

发明人： Akihito Seki ,  Masatoshi Okutomi

IPC分类号： G06K9/00

CPC分类号： G06K9/00805 ,  G06K2009/3291 ,  G06T7/74

摘要： An object position area (82a) is calculated according to a position in the space of a detected truck (70). A template (80a) corresponding to the object position area (82a) recorded at the previous time is then called. The template (80a) is moved to a position on a reference image Ib where the similarity is highest. Overlap rate (R(t-1)⊥Rt) of the object position area (82a) and the template (80a) is calculated. A decision is made whether the object is identical to that detected in the past by using the overlap rate.

摘要翻译： 根据检测到的卡车（70）的空间中的位置来计算物体位置区域（82a）。 然后调用与先前记录的对象位置区域（82a）对应的模板（80a）。 将模板（80a）移动到相似度最高的参考图像Ib上的位置。 计算对象位置区域（82a）和模板（80a）的重叠率（R（t-1）⊥Rt）。 通过使用重叠率来确定对象是否与过去检测到的对象相同。

公开(公告)号：US20090167844A1

公开(公告)日：2009-07-02

申请号：US11659884

申请日：2005-08-11

申请人： Akihito Seki ,  Masatoshi Okutomi

发明人： Akihito Seki ,  Masatoshi Okutomi

IPC分类号： H04N13/02 ,  H04N7/18

CPC分类号： G06K9/00805 ,  B60R1/00 ,  B60R2300/107 ,  B60R2300/8093 ,  G06K2009/3291 ,  G06T7/74 ,  H04N7/181

摘要： A standard camera (12) picks up a standard image Ib, and a reference camera (14) picks up a reference image Ir. A flat area IIf is extracted from the standard image Ib and the reference image Ir. An edge image is created by extracting the edges and feature points from the standard image Ib and then a corrected edge image (62) is created by removing the flat area IIf. Object detection processing is carried out on the edges and feature points of the corrected edge image (62) with reference to the reference image Ir.

摘要翻译： 标准相机（12）拾取标准图像Ib，并且参考相机（14）拾取参考图像Ir。 从标准图像Ib和参考图像Ir中提取平坦区域IIf。 通过从标准图像Ib提取边缘和特征点来创建边缘图像，然后通过去除平坦区域IIf来创建经校正的边缘图像（62）。 参考图像Ir对被校正后的边缘图像（62）的边缘和特征点进行对象检测处理。

公开(公告)号：US20090080805A1

公开(公告)日：2009-03-26

申请号：US11666605

申请日：2005-10-17

申请人： Masayuki Tanaka ,  Masatoshi Okutomi

发明人： Masayuki Tanaka ,  Masatoshi Okutomi

IPC分类号： G06K9/32

CPC分类号： H04N1/3935 ,  G06T3/4069

摘要： A method is provided for speeding up a super-resolution processing by reducing the number of times for convolution operation that is the number of times for estimation calculation.A fast method of super-resolution processing for speeding up a super-resolution processing that estimates a high-resolution image from multiple low-resolution images with a displacement, which comprising: a first step for performing a registration of said multiple low-resolution images in a high-resolution image space and treating all pixels of said multiple low-resolution images after the registration as pixels sampled at unequal interval within said high-resolution image space; a second step for dividing said high-resolution image space into multiple small areas with a predefined size; and a third step for defining an estimated value at a predefined representative position within said small area as an estimated value of all pixels that exist within said small area for each small area divided in said second step.

摘要翻译： 提供了一种通过减少作为估计计算次数的卷积运算次数来加速超分辨率处理的方法。 一种超分辨率处理的快速方法，用于加速从具有位移的多个低分辨率图像估计高分辨率图像的超分辨率处理，其包括：第一步骤，用于执行所述多个低分辨率图像的登记 在高分辨率图像空间中，并且将所述多个低分辨率图像的所有像素处理为所述高分辨率图像空间中以不等间隔采样的像素; 用于将所述高分辨率图像空间划分成具有预定尺寸的多个小区域的第二步骤; 以及第三步骤，用于在所述小区域内的预定代表性位置处定义估计值，作为在所述第二步骤中划分的每个小区域，存在于所述小区域内的所有像素的估计值。

公开(公告)号：US20070296829A1

公开(公告)日：2007-12-27

申请号：US11667763

申请日：2005-11-15

申请人： Tomoyuki Nakamura ,  Takahiro Yano ,  Masatoshi Okutomi ,  Masao Shimizu

发明人： Tomoyuki Nakamura ,  Takahiro Yano ,  Masatoshi Okutomi ,  Masao Shimizu

IPC分类号： H04N5/235

CPC分类号： H04N5/232 ,  H04N5/2251 ,  H04N5/2625

摘要： The invention provides an imaging device, an imaging system and an image photography method which can construct an image having a higher resolution than a photographed image. The imaging device is constituted by an optical imaging unit 11 (an optical imaging means for imaging an image of a subject), an imaging unit 12 (a means for converting an image imaged optically into an image signal that is discretized spatially and is sampled), an image processing unit 15 (a means for generating a high-resolution image from image signals of multiple frames), a moving velocity detecting unit 13 (a means for detecting a status change of the imaging device itself), and an imaging timing deciding unit 14 (a means for deciding a imaging timing). The imaging device is constituted such as to construct the high-resolution image from an imaging element with a little number of the pixels.

摘要翻译： 本发明提供一种成像装置，成像系统和图像摄影方法，其可以构造具有比拍摄图像更高的分辨率的图像。 成像装置由光学成像单元11（用于对对象的图像进行成像的光学成像装置），成像单元12（用于将光学成像的图像转换成空间离散化并被采样的图像信号的装置） ，图像处理单元15（用于从多帧的图像信号生成高分辨率图像的装置），移动速度检测单元13（用于检测成像装置本身的状态变化的装置）和成像定时决定 单元14（用于决定成像定时的装置）。 成像装置被构造成从具有少量像素的成像元件构造高分辨率图像。

公开(公告)号：US20070035621A1

公开(公告)日：2007-02-15

申请号：US10572172

申请日：2005-04-12

申请人： Masao Shimizu ,  Masatoshi Okutomi

发明人： Masao Shimizu ,  Masatoshi Okutomi

IPC分类号： H04N7/18 ,  H04N5/225

CPC分类号： G06T3/4069

摘要： The present invention provides a movement decision method for determining direction and distance of one-dimensional movement of image capturing object or image capturing element for capturing two-dimensional sub-pixel motion image suitable for super-resolution processing, and an image capturing device using this movement decision method. while image capturing object is moved along a predetermined one-dimensional moving direction, sequential image of image capturing object is captured by fixed image capturing device, sequential image is set to two-dimensional sub-pixel motion image suitable for super-resolution processing, and one-dimensional moving direction of image capturing object in a coordinate system normalized by aspect ratio of pixel of image capturing element within image capturing device is determined to p/q of a rational number, wherein: one pixel of vertical direction of coordinate system is divided by an integer p, and one pixel of horizontal direction of coordinate system is divided by an integer q.

摘要翻译： 本发明提供了一种用于确定用于捕获适合于超分辨率处理的二维子像素运动图像的图像捕获对象或图像捕获元件的一维运动的方向和距离的运动判定方法，以及使用该方法的图像捕获装置 运动决策方法。 当图像拍摄对象沿着预定的一维移动方向移动时，图像捕获对象的顺序图像被固定图像捕获装置捕获，顺序图像被设置为适合于超分辨率处理的二维子像素运动图像，以及 将由图像拍摄装置内的图像拍摄元件的像素的高宽比归一化的坐标系中的图像拍摄对象的一维移动方向确定为有理数的p / q，其中：分割坐标系的垂直方向的一个像素 乘以整数p，将坐标系的水平方向的一个像素除以整数q。

公开(公告)号：US6023276A

公开(公告)日：2000-02-08

申请号：US493288

申请日：1995-06-21

申请人： Tomoaki Kawai ,  Masatoshi Okutomi ,  Shinji Uchiyama ,  Masakazu Fujiki

发明人： Tomoaki Kawai ,  Masatoshi Okutomi ,  Shinji Uchiyama ,  Masakazu Fujiki

IPC分类号： G01B11/24 ,  G01B11/245 ,  G06T1/00 ,  G06T7/00 ,  H04N13/00 ,  G06T17/00

CPC分类号： G06T7/0075 ,  G06T2207/10012 ,  H04N13/0003 ,  H04N2013/0081 ,  H04N2013/0096

摘要： Inputted right and left images of a stereoscopic image are displayed on a bitmap display 1-5, and vertices to be used for forming three dimensional model of each object are inputted by a pointing device 1-7. At this time, if objects to be processed have to be changed, an instruction for changing objects is issued. Accordingly, it is possible to input and manage point data of each object independently.

摘要翻译： 立体图像的输入的左右图像被显示在位图显示1-5上，并且用于形成每个对象的三维模型的顶点由指示装置1-7输入。 此时，如果要处理的对象必须被改变，则发出用于改变对象的指令。 因此，可以独立地输入和管理每个对象的点数据。

公开(公告)号：US08873889B2

公开(公告)日：2014-10-28

申请号：US13578542

申请日：2011-02-10

申请人： Shunichi Koga ,  Masayuki Tanaka ,  Masatoshi Okutomi

发明人： Shunichi Koga ,  Masayuki Tanaka ,  Masatoshi Okutomi

IPC分类号： G06K9/32 ,  H04N5/232 ,  H04N1/387 ,  G06T3/40

CPC分类号： G06K9/32 ,  G06T3/4053 ,  H04N1/3871 ,  H04N5/232

摘要： An image processing apparatus comprises a processing unit for computing displacement amounts between a basis image and each reference image, a processing unit for generating multiple deformed images based on the displacement amounts, the basis image and multiple reference images, a processing unit for setting a threshold of a parameter, a processing unit for selecting image information from the reference image by the threshold, a processing unit for generating composed images and weighted images based on the basis image, the displacement amounts and the image information, a processing unit for generating high-resolution grid images by dividing the composed image by the weighted image, a processing unit for generating simplified interpolation images based on high-resolution grid images, a processing unit for generating assistance images, a display unit for displaying the assistance images and a control unit that controls the necessary processing as necessary.

摘要翻译： 一种图像处理装置，包括用于计算基础图像和每个参考图像之间的位移量的处理单元，用于基于所述位移量产生多个变形图像的处理单元，基础图像和多个参考图像，用于设置阈值的处理单元 参数的处理单元，用于从参考图像中选择阈值的图像信息的处理单元，用于基于基础图像，位移量和图像信息生成合成图像和加权图像的处理单元， 通过将合成图像除以加权图像的分辨率网格图像，用于基于高分辨率网格图像生成简化插值图像的处理单元，用于产生辅助图像的处理单元，用于显示辅助图像的显示单元和控制单元， 根据需要控制必要的处理。