公开(公告)号：US20060078206A1

公开(公告)日：2006-04-13

申请号：US11223050

申请日：2005-09-12

申请人： Nao Mishima ,  Go Ito ,  Masahiro Baba

发明人： Nao Mishima ,  Go Ito ,  Masahiro Baba

IPC分类号： G06K9/62

CPC分类号： G06K9/6206

摘要： An image matching apparatus includes a numerical analyzing unit that solves an equation of motion numerically. The equation of motion is formulated as an image matching state transition model representing a mapping relation between a source image and a destination image. The equation of motion represents a force applied on each lattice point of the destination image including potential energy force. The numerical analyzing unit calculates the potential energy force, and sets a convergence value of a solution of the equation of motion as a mapping relation between the lattice point of the source image and the lattice point of the destination image based on the numerical analysis.

公开(公告)号：US08805020B2

公开(公告)日：2014-08-12

申请号：US13052194

申请日：2011-03-21

申请人： Takeshi Mita ,  Nao Mishima ,  Kenichi Shimoyama ,  Ryusuke Hirai

发明人： Takeshi Mita ,  Nao Mishima ,  Kenichi Shimoyama ,  Ryusuke Hirai

IPC分类号： G06K9/00 ,  G06K9/46 ,  G06K9/66 ,  G06K9/20 ,  G06K9/36 ,  H04N15/00 ,  H04N13/00 ,  G06T15/00 ,  G06T7/00 ,  G06T7/40

CPC分类号： G06K9/4642 ,  G06K9/00697 ,  G06K9/00704 ,  G06K9/6269 ,  G06T7/50 ,  G06T7/80 ,  G06T7/90 ,  G06T2207/10016 ,  G06T2207/10028 ,  G06T2207/20021 ,  H04N13/261

摘要： According to one embodiment, a depth signal generating apparatus includes following units. The calculating unit is configured to calculate a statistic value for pixel values for each of predefined areas in the first image, and calculate, for each of predetermined base depth models, a first evaluation value based on the calculated statistic value. The correcting unit is configured to correct, based on a second evaluation value previously derived for the second image and a first degree of similarity indicating a similarity between the predetermined base depth models, the first evaluation value to derive second evaluation values for the predetermined base depth models. The selecting unit is configured to select a base depth model having the highest second evaluation value from the predetermined base depth models. The generating unit is configured to generate a depth signal based on the selected base depth model.

摘要翻译： 根据一个实施例，深度信号发生装置包括以下单元。 计算单元被配置为计算第一图像中的每个预定区域的像素值的统计值，并且针对每个预定基础深度模型，基于所计算的统计值来计算第一评估值。 校正单元被配置为基于先前为第二图像导出的第二评估值和指示预定基准深度模型之间的相似度的第一相似程度来校正第一评估值，以获得预定基础深度的第二评估值 楷模。 选择单元被配置为从预定的基本深度模型中选择具有最高的第二评估值的基础深度模型。 生成单元被配置为基于所选择的基础深度模型生成深度信号。

公开(公告)号：US08289376B2

公开(公告)日：2012-10-16

申请号：US13415381

申请日：2012-03-08

申请人： Nao Mishima ,  Kenichi Shimoyama ,  Takeshi Mita ,  Takashi Ida

发明人： Nao Mishima ,  Kenichi Shimoyama ,  Takeshi Mita ,  Takashi Ida

IPC分类号： H04N13/00

CPC分类号： G06T7/97 ,  H04N13/221

摘要： An image processing method for creating a disparity image for 3D display from a 2D video image includes detecting based on a first image of the 2D video image in a time and a second image in a time different from the first image, motion vectors between the first and second images for each block of the first image, detecting from the motion vectors, a most backward vector of a portion whose depth is on the back side, calculating differential vectors between each motion vector and the most backward vector and giving a depth on a close to the block of the first image corresponding to the motion vector having the larger differential vector and creating one or more disparity images from the first image and the depth.

摘要翻译： 一种用于从2D视频图像创建用于3D显示的视差图像的图像处理方法包括：在与第一图像不同的时间内基于2D视频图像的第一图像和第二图像的检测，第一图像与第一图像之间的运动矢量 以及第一图像的每个块的第二图像，从运动矢量检测深度在背面的部分的最后向量，计算每个运动矢量与最后向矢量之间的差分向量，并且在 靠近与具有较大差分矢量的运动矢量对应的第一图像的块，并且从第一图像和深度创建一个或多个视差图像。

公开(公告)号：US20120162223A1

公开(公告)日：2012-06-28

申请号：US13409213

申请日：2012-03-01

申请人： Ryusuke Hirai ,  Hidenori Takeshima ,  Takeshi Mita ,  Nao Mishima ,  Kenichi Shimoyama ,  Takashi Ida

发明人： Ryusuke Hirai ,  Hidenori Takeshima ,  Takeshi Mita ,  Nao Mishima ,  Kenichi Shimoyama ,  Takashi Ida

IPC分类号： G06T15/00

CPC分类号： G06T3/4007 ,  H04N13/106 ,  H04N13/128 ,  H04N13/261 ,  H04N2013/0081

摘要： According to one embodiment, a parallax image generating apparatus includes a deriving unit, a generating unit, a first calculating unit, a setting unit, a searching unit, and an interpolating unit. The deriving unit derives a parallax vector corresponding to a first pixel from the input image and depth information associated with the first pixel. The generating unit generates an intermediate image. The first calculating unit calculates first weights for respective pixels of a parallax image. The setting unit sets one or more candidate blocks near a shade-forming-area pixel of the intermediate image, and sets a reference block among one or more candidate blocks. The searching unit searches a target block similar to the reference block in the input image and/or the intermediate image. The interpolating unit interpolates a pixel value of the shade-forming-area pixel.

摘要翻译： 根据一个实施例，视差图像生成装置包括导出单元，生成单元，第一计算单元，设置单元，搜索单元和内插单元。 导出单元从输入图像中导出对应于第一像素的视差矢量和与第一像素相关联的深度信息。 生成单元生成中间图像。 第一计算单元计算视差图像的各个像素的第一权重。 设置单元在中间图像的阴影形成区域像素附近设置一个或多个候选块，并且在一个或多个候选块中设置参考块。 搜索单元在输入图像和/或中间图像中搜索与参考块类似的目标块。 内插单元内插色调形成区域像素的像素值。

公开(公告)号：US20120082368A1

公开(公告)日：2012-04-05

申请号：US13181888

申请日：2011-07-13

申请人： Ryusuke HIRAI ,  Nao Mishima ,  Takeshi Mita ,  Masahiro Baba

发明人： Ryusuke HIRAI ,  Nao Mishima ,  Takeshi Mita ,  Masahiro Baba

IPC分类号： G06K9/00

CPC分类号： G06T5/002 ,  G06T5/50 ,  G06T2200/04 ,  G06T2207/10028 ,  G06T2207/20012 ,  G06T2207/20076 ,  G06T2207/20212 ,  H04N13/128

摘要： According to one embodiment, a depth correction apparatus includes a clusterer, a calculator and a corrector. The clusterer is configured to apply clustering to at least one of pixel values and depth values of a plurality of pixels in a calculation range corresponding to a correction target pixel, and to classify the plurality of pixels in the calculation range into a plurality of classes. The calculator is configured to calculate pixel value statistics of the respective classes using pixel values of pixels in the respective classes. The corrector is configured to determine a corresponding class of the correction target pixel based on a pixel value of the correction target pixel and the pixel value statistics of the respective classes, and to apply correction which replaces a depth value of the correction target pixel by a representative depth value of the corresponding class.

摘要翻译： 根据一个实施例，深度校正装置包括聚类器，计算器和校正器。 聚类器被配置为将聚类应用于与校正目标像素相对应的计算范围中的多个像素的像素值和深度值中的至少一个，并将计算范围内的多个像素分类为多个类别。 计算器被配置为使用各个类中的像素的像素值来计算各个类的像素值统计。 校正器被配置为基于校正目标像素的像素值和各个类别的像素值统计来确定校正对象像素的对应类别，并且将修正目标像素的深度值替换为校正对象像素的深度值的校正 相应类的代表性深度值。

公开(公告)号：US20120057760A1

公开(公告)日：2012-03-08

申请号：US13221938

申请日：2011-08-31

申请人： Takuma YAMAMOTO ,  Nao Mishima

发明人： Takuma YAMAMOTO ,  Nao Mishima

IPC分类号： G06K9/00

CPC分类号： G06T7/238 ,  G06T2207/10016 ,  G06T2207/20021

摘要： A motion vector detection device includes: a matching error calculation part that calculates matching errors between a focus block and each of reference blocks; a least matching error calculation part calculating a least matching error from among the matching errors; a threshold calculation part calculating a threshold value; a correction vector calculation part calculating a correction vector from motion vectors detected in the reference blocks; and a motion vector determination part determining, as a motion vector for the focus block, a relative position vector in a block in which the relative position vector with respect to the focus block is the closest to the correction vector, the block being selected from among the reference blocks in which a difference between the plurality of matching errors and the least matching error is within the threshold value.

摘要翻译： 运动矢量检测装置包括：匹配误差计算部，其计算聚焦块与各参考块之间的匹配误差; 从所述匹配误差中计算最小匹配误差的最小匹配误差计算部; 计算阈值的阈值计算部; 校正矢量计算部分，从参考块中检测的运动矢量计算校正矢量; 以及运动矢量确定部，其确定作为所述焦点块的运动矢量的相对于所述焦点块的相对位置矢量最接近所述校正向量的块中的相对位置矢量，所述块选自 其中多个匹配误差和最小匹配误差之间的差在阈值内的参考块。

公开(公告)号：US20100061651A1

公开(公告)日：2010-03-11

申请号：US12408861

申请日：2009-03-23

申请人： Nao Mishima ,  Kenzo Isogawa ,  Masahiro Baba

发明人： Nao Mishima ,  Kenzo Isogawa ,  Masahiro Baba

IPC分类号： G06K9/40

CPC分类号： G06T5/003 ,  G06T5/20 ,  G06T2207/20008

摘要： A degraded-image restoration method includes inputting a degraded image degraded by a predetermined degradation process; reading from a storage unit a filter coefficient in a filtering process of restoring the degraded image, in which an iteration formula for minimizing a square error between the degraded image and an image obtained by degrading a restored image by the degradation process is expanded corresponding to a predetermined number of iterations; and performing the filtering process using the filter coefficient with respect to the degraded image to obtain a restored image of the degraded image. Accordingly, a throughput in an apparatus that restores the degraded image can be reduced, thereby obtaining a preferable restored image.

摘要翻译： 降级图像恢复方法包括：输入由预定的降级处理降级的退化图像; 从存储单元读取在恢复劣化图像的滤波处理中的滤波器系数，其中通过劣化图像和通过劣化处理降级恢复图像而获得的图像之间的平方误差最小化的迭代公式对应于 预定次数的迭代; 以及使用关于劣化图像的滤波器系数来执行滤波处理，以获得退化图像的恢复图像。 因此，可以减少恢复劣化图像的装置中的吞吐量，从而获得优选的恢复图像。

公开(公告)号：US07375762B2

公开(公告)日：2008-05-20

申请号：US10855617

申请日：2004-05-28

申请人： Nao Mishima ,  Go Ito

发明人： Nao Mishima ,  Go Ito

IPC分类号： H04N7/01 ,  H04N5/21

CPC分类号： H04N5/145 ,  H04N7/014

摘要： An image interpolation method comprises searching a motion vector from different pairs of blocks on a first and a second reference image symmetrically, extracting a first and a second image block from the first and the second reference image, respectively, the first and the second image block being located by the motion vector, determining a region determination threshold using an absolute difference between paired opposite pixels of the first and the second image block, extracting from each of the first and the second image block a first pixel region that the absolute difference is smaller than the region determination threshold, and obtaining a pixel value of a second pixel region of the to-be-interpolated block from a pixel value of the first pixel region of each of the first and the second image block, the second pixel region corresponding to the first pixel region.

摘要翻译： 图像插值方法包括：对对称地搜索第一和第二参考图像上的不同对块对的运动矢量，分别从第一和第二参考图像提取第一和第二图像块，第一和第二图像块 由所述运动矢量定位，使用所述第一和第二图像块的成对的相对像素之间的绝对差来确定区域确定阈值，从所述第一和第二图像块中的每一个提取绝对差较小的第一像素区域 并且从第一和第二图像块中的每个的第一像素区域的像素值获得待插值块的第二像素区域的像素值，对应于第二像素区域 第一像素区域。

公开(公告)号：US20050157792A1

公开(公告)日：2005-07-21

申请号：US11032167

申请日：2005-01-11

申请人： Masahiro Baba ,  Nao Mishima

发明人： Masahiro Baba ,  Nao Mishima

IPC分类号： G06T3/40 ,  G06T7/20 ,  H04N7/01 ,  H04N7/12

CPC分类号： H04N7/014 ,  G06T3/4007 ,  G06T7/20

摘要： An interpolation image generating method includes dividing each of the first reference image and the second reference image into reference regions each including pixels, executing a correlation operation between the first reference image and first destination images located before and after the first reference image and a correlation operation between the second reference image and a second destination image to derive motion vectors for the first and second destination images every reference region, obtaining correlation values between the regions of the first and second destination images that are indicated by the motion vectors and the reference region to determine the reference region as a high or low correlation region, generating an interpolation image candidate between the first reference and second images using the reference region determined as the high correlation region, and mixing the interpolation image candidates using the motion vectors of the reference region to produce an interpolation image.

摘要翻译： 插值图像生成方法包括将第一参考图像和第二参考图像中的每一个分成包括像素的参考区域，执行第一参考图像和位于第一参考图像之前和之后的第一目的地图像之间的相关运算，以及相关运算 在第二参考图像和第二目的地图像之间，以导出每个参考区域的第一和第二目的地图像的运动矢量，获得由运动矢量和参考区域指示的第一和第二目的地图像的区域之间的相关值， 将所述参考区域确定为高相关区域或低相关区域，使用被确定为所述高相关区域的所述参考区域，在所述第一参考图像和所述第二图像之间生成内插图像候选，以及使用所述参考区域的运动矢量将所述内插图像候选 生产 内插图像。

公开(公告)号：US09110296B2

公开(公告)日：2015-08-18

申请号：US13666194

申请日：2012-11-01

申请人： Nao Mishima ,  Takeshi Mita

发明人： Nao Mishima ,  Takeshi Mita

IPC分类号： H04N13/02 ,  G02B27/22 ,  H04N13/04

CPC分类号： G02B27/2214 ,  H04N13/305 ,  H04N13/317 ,  H04N13/349

摘要： According to an image processing device includes an acquiring unit and a correcting unit. The acquiring unit is configured to acquire a stereoscopic image containing a plurality of parallax images each having a mutually different parallax. The correcting unit is configured to perform, for each pixel of the stereoscopic image, correction to set a parallax number of a parallax image viewed at a viewpoint position to a first parallax number of a parallax image to be viewed at the viewpoint position by using correction data representing a difference value between the first parallax number and a second parallax number of a parallax image that is actually viewed at the viewpoint position and on which distortion correction for correcting distortion of light beams has been performed.

摘要翻译： 根据图像处理装置包括获取单元和校正单元。 获取单元被配置为获取包含具有彼此不同的视差的多个视差图像的立体图像。 校正单元被配置为对于立体图像的每个像素执行校正，以通过使用校正将在视点位置处观看的视差图像的视差编号设置为在视点位置观看的视差图像的第一视差编号 表示在视点位置上实际观看的视差图像的第一视差数和第二视差编号之间的差值的数据，并且进行用于校正光束失真的失真校正。