公开(公告)号：US08189104B2

公开(公告)日：2012-05-29

申请号：US11687080

申请日：2007-03-16

申请人： Kazuyasu Ohwaki ,  Yasutoyo Takeyama ,  Goh Itoh ,  Nao Mishima

发明人： Kazuyasu Ohwaki ,  Yasutoyo Takeyama ,  Goh Itoh ,  Nao Mishima

IPC分类号： H04N11/20

CPC分类号： H04N5/144 ,  G06T3/4007 ,  H04N7/014

摘要： An apparatus for creating an interpolation frame includes a first computing unit that computes a first motion vector in relation to a first block in a first reference frame, a second extracting unit that extracts a second block in a second reference frame based on the first motion vector, a first calculating unit that calculates a correlation between the first block and the second block, a third extracting unit that extracts a third block that is shifted from the second block by a certain number of pixels, a second calculating unit that calculates a correlation between the first block and the third block, and a third computing unit that computes a motion vector for an interpolation block based on a most-highly correlated block-pair.

摘要翻译： 一种用于创建内插帧的装置包括：第一计算单元，其计算关于第一参考帧中的第一块的第一运动矢量;第二提取单元，其基于第一运动矢量提取第二参考帧中的第二块 计算第一块和第二块之间的相关性的第一计算单元，提取从第二块移位了一定数量的像素的第三块的第三提取单元，计算第一块和第二块之间的相关性的第二计算单元， 第一块和第三块，以及第三计算单元，其基于最高关联块对来计算用于插值块的运动矢量。

公开(公告)号：US20080069221A1

公开(公告)日：2008-03-20

申请号：US11687080

申请日：2007-03-16

申请人： Kazuyasu Ohwaki ,  Yasutoyo Takeyama ,  Goh Itoh ,  Nao Mishima

发明人： Kazuyasu Ohwaki ,  Yasutoyo Takeyama ,  Goh Itoh ,  Nao Mishima

IPC分类号： H04B1/66

CPC分类号： H04N5/144 ,  G06T3/4007 ,  H04N7/014

摘要： An apparatus for creating an interpolation frame includes a first computing unit that computes a first motion vector in relation to a first block in a first reference frame, a second extracting unit that extracts a second block in a second reference frame based on the first motion vector, a first calculating unit that calculates a correlation between the first block and the second block, a third extracting unit that extracts a third block that is shifted from the second block by a certain number of pixels, a second calculating unit that calculates a correlation between the first block and the third block, and a third computing unit that computes a motion vector for an interpolation block based on a most-highly correlated block-pair.

摘要翻译： 一种用于创建内插帧的装置包括：第一计算单元，其计算关于第一参考帧中的第一块的第一运动矢量;第二提取单元，其基于第一运动矢量提取第二参考帧中的第二块 计算第一块和第二块之间的相关性的第一计算单元，提取从第二块移位了一定数量的像素的第三块的第三提取单元，计算第一块和第二块之间的相关性的第二计算单元， 第一块和第三块，以及第三计算单元，其基于最高关联块对来计算用于插值块的运动矢量。

公开(公告)号：US07936950B2

公开(公告)日：2011-05-03

申请号：US11674503

申请日：2007-02-13

申请人： Kazuyasu Ohwaki ,  Goh Itoh ,  Nao Mishima ,  Yasutoyo Takeyama

发明人： Kazuyasu Ohwaki ,  Goh Itoh ,  Nao Mishima ,  Yasutoyo Takeyama

IPC分类号： G06K9/32

CPC分类号： H04N19/573 ,  H04N19/17 ,  H04N19/176 ,  H04N19/51 ,  H04N19/543 ,  H04N19/61

摘要： An area detecting unit detects a first matching area in a first reference block in the first reference frame, a second matching area in a second reference block in the second reference frame. A settling unit settles a secondary motion vector to be assigned to a mismatching area in the each interpolation block, based on surrounding interpolation blocks around the mismatching area. A motion compensating unit assigns an image to the interpolation frame based on the primary motion vector and the secondary motion vector.

摘要翻译： 区域检测单元检测第一参考帧中的第一参考块中的第一匹配区域，第二参考帧中的第二参考块中的第二匹配区域。 基于围绕不匹配区域的周围插值块，建立单元将每个插值块中的不匹配区域分配给二次运动矢量。 运动补偿单元基于主运动矢量和次运动矢量将图像分配给插值帧。

公开(公告)号：US20070230830A1

公开(公告)日：2007-10-04

申请号：US11674503

申请日：2007-02-13

申请人： Kazuyasu Ohwaki ,  Goh Itoh ,  Nao Mishima ,  Yasutoyo Takeyama

发明人： Kazuyasu Ohwaki ,  Goh Itoh ,  Nao Mishima ,  Yasutoyo Takeyama

IPC分类号： G06K9/32

CPC分类号： H04N19/573 ,  H04N19/17 ,  H04N19/176 ,  H04N19/51 ,  H04N19/543 ,  H04N19/61

摘要： An area detecting unit detects a first matching area in a first reference block in the first reference frame, a second matching area in a second reference block in the second reference frame. A settling unit settles a secondary motion vector to be assigned to a mismatching area in the each interpolation block, based on surrounding interpolation blocks around the mismatching area. A motion compensating unit assigns an image to the interpolation frame based on the primary motion vector and the secondary motion vector.

摘要翻译： 区域检测单元检测第一参考帧中的第一参考块中的第一匹配区域，第二参考帧中的第二参考块中的第二匹配区域。 基于围绕不匹配区域的周围插值块，建立单元将每个插值块中的不匹配区域分配给二次运动矢量。 运动补偿单元基于主运动矢量和次运动矢量将图像分配给插值帧。

公开(公告)号：US08130840B2

公开(公告)日：2012-03-06

申请号：US12408424

申请日：2009-03-20

申请人： Nao Mishima ,  Ryusuke Hirai ,  Yasutoyo Takeyama ,  Goh Itoh

发明人： Nao Mishima ,  Ryusuke Hirai ,  Yasutoyo Takeyama ,  Goh Itoh

IPC分类号： H04N7/12

CPC分类号： H04N5/144 ,  G06T3/4007 ,  H04N19/117 ,  H04N19/132 ,  H04N19/139 ,  H04N19/51 ,  H04N19/521 ,  H04N19/527 ,  H04N19/577 ,  H04N19/587

摘要： An interpolated image generating apparatus calculates a motion vector reliability level indicating reliability of a motion vector used for inserting an interpolated image, the value of the motion vector reliability level being determined in such a manner that the stronger the correlation is between a source image area and a destination image area that are brought into correspondence with each other by the motion vector, the larger is the value. The apparatus also calculates a failure-preventing vector reliability level indicating reliability of a predetermined failure-preventing vector used for preventing image failures. The apparatus obtains a motion compensated image based on the motion vector, obtains a failure-preventing image based on the failure-preventing vector, and blends the motion compensated image and the failure-preventing image according to a weighted average thereof calculated by using a weighting factor based on the motion vector reliability level and the failure-preventing vector reliability level.

摘要翻译： 内插图像生成装置计算表示用于插入内插图像的运动矢量的可靠性的运动矢量可靠度水平，运动矢量可靠性水平的值被确定为使源图像区域和源图像区域之间的相关性越强 通过运动矢量相互对应的目的地图像区域的值越大。 该装置还计算表示用于防止图像故障的预定故障防止向量的可靠性的防故障向量可靠性水平。 该装置基于运动矢量获得运动补偿图像，基于防故障向量获得防故障图像，并且根据通过使用加权来计算的加权平均值来混合运动补偿图像和防故障图像 基于运动矢量可靠度水平和防故障矢量可靠性水平的因子。

公开(公告)号：US20090244389A1

公开(公告)日：2009-10-01

申请号：US12408424

申请日：2009-03-20

申请人： Nao Mishima ,  Ryusuke Hirai ,  Yasutoyo Takeyama ,  Goh Itoh

发明人： Nao Mishima ,  Ryusuke Hirai ,  Yasutoyo Takeyama ,  Goh Itoh

IPC分类号： H04N5/14 ,  G06K9/32

CPC分类号： H04N5/144 ,  G06T3/4007 ,  H04N19/117 ,  H04N19/132 ,  H04N19/139 ,  H04N19/51 ,  H04N19/521 ,  H04N19/527 ,  H04N19/577 ,  H04N19/587

摘要： An interpolated image generating apparatus calculates a motion vector reliability level indicating reliability of a motion vector used for inserting an interpolated image, the value of the motion vector reliability level being determined in such a manner that the stronger the correlation is between a source image area and a destination image area that are brought into correspondence with each other by the motion vector, the larger is the value. The apparatus also calculates a failure-preventing vector reliability level indicating reliability of a predetermined failure-preventing vector used for preventing image failures. The apparatus obtains a motion compensated image based on the motion vector, obtains a failure-preventing image based on the failure-preventing vector, and blends the motion compensated image and the failure-preventing image according to a weighted average thereof calculated by using a weighting factor based on the motion vector reliability level and the failure-preventing vector reliability level.

摘要翻译： 内插图像生成装置计算表示用于插入内插图像的运动矢量的可靠性的运动矢量可靠度水平，运动矢量可靠性水平的值被确定为使源图像区域和源图像区域之间的相关性越强 通过运动矢量相互对应的目的地图像区域的值越大。 该装置还计算表示用于防止图像故障的预定故障防止向量的可靠性的防故障向量可靠性水平。 该装置基于运动矢量获得运动补偿图像，基于防故障向量获得防故障图像，并且根据通过使用加权来计算的加权平均值来混合运动补偿图像和防故障图像 基于运动矢量可靠度水平和防故障矢量可靠性水平的因子。

公开(公告)号：US20090079836A1

公开(公告)日：2009-03-26

申请号：US12235108

申请日：2008-09-22

申请人： Nao Mishima ,  Yasutoyo Takeyama ,  Masahiro Baba ,  Goh Itoh

发明人： Nao Mishima ,  Yasutoyo Takeyama ,  Masahiro Baba ,  Goh Itoh

IPC分类号： G06K9/32 ,  H04N5/228

CPC分类号： H04N5/262 ,  G06T3/4007 ,  G06T5/004 ,  G06T7/231 ,  G06T2207/10016 ,  G06T2207/20201 ,  H04N5/23254 ,  H04N5/772 ,  H04N5/781 ,  H04N5/85

摘要： An image processing apparatus includes a correction-amount calculating unit that calculates a motion-blur correction amount, which takes a larger value as the reproduction speed becomes lower, based on an input reproduction speed; a motion-blur correcting unit that performs scale transformation on a motion vector based on the motion-blur correction amount, acquires low frequency components of a source image and a destination image using an anisotropic Gaussian filter determined by a direction and a size of the motion vector subjected to the scale transformation, and performs edge enhancement on the source image and the destination image based on the low frequency components and high frequency components of the source image and the destination image; and an interpolation-image creating unit that creates the interpolation image using the source image for which the motion blur is corrected, the destination image for which the motion blur is corrected, and the motion vector.

摘要翻译： 一种图像处理装置，包括校正量计算单元，其基于输入的再现速度来计算随着再现速度变低的变化而获得较大值的运动模糊校正量; 使用基于运动模糊校正量对运动矢量执行缩放变换的运动模糊校正单元，使用由运动的方向和尺寸确定的各向异性高斯滤波器来获取源图像和目的地图像的低频分量 进行缩放变换的矢量，并且基于源图像和目的图像的低频分量和高频分量对源图像和目的图像执行边缘增强; 以及内插图像生成单元，其使用校正了运动模糊的源图像，校正运动模糊的目的地图像和运动矢量来生成插值图像。

公开(公告)号：US20080240241A1

公开(公告)日：2008-10-02

申请号：US12056085

申请日：2008-03-26

申请人： Nao Mishima ,  Yasutoyo Takeyama ,  Goh Itoh

发明人： Nao Mishima ,  Yasutoyo Takeyama ,  Goh Itoh

IPC分类号： H04N7/48

CPC分类号： H04N7/014 ,  G06T3/4007 ,  H04N7/0127

摘要： A first motion vector points from a source region of a source picture to a destination region of a destination picture. A second motion vector is scaled from the first motion vector based on a first temporal distance between the source picture and the interpolation picture. A third motion vector is scaled from the first motion vector based on a second temporal distance between the destination picture and the interpolation picture. A weight of a first interpolation region of the interpolation picture is calculated using distortion energy of the source region. A first motion compensation picture compensated from the source region to a temporal position of the interpolation picture using the second motion vector, and a second motion compensation picture compensated from the destination region to the temporal position using the third motion vector are calculated. A third motion compensation picture is calculated by weighted-averaging the first motion compensation picture and the second motion compensation picture. A second interpolation region of the interpolation picture is calculated by averaging a region of the third motion compensation picture and a region of an artifact prevention picture with the weight.

摘要翻译： 第一运动矢量从源图像的源区域指向目的图像的目的地区域。 基于源图像和插值图像之间的第一时间距离，从第一运动矢量对第二运动矢量进行缩放。 基于目的地图像和内插图像之间的第二时间距离，从第一运动矢量对第三运动矢量进行缩放。 使用源区域的失真能量来计算内插图像的第一内插区域的权重。 计算使用第二运动矢量从源区域补偿到内插图像的时间位置的第一运动补偿图像，以及使用第三运动矢量从目的地区域补偿到时间位置的第二运动补偿图像。 通过对第一运动补偿图像和第二运动补偿图像进行加权平均来计算第三运动补偿图像。 通过对第三运动补偿图像的区域和具有权重的伪像防止图像的区域进行平均来计算内插图像的第二内插区域。

公开(公告)号：US07899122B2

公开(公告)日：2011-03-01

申请号：US11368440

申请日：2006-03-07

申请人： Kazuyasu Ohwaki ,  Goh Itoh ,  Nao Mishima

发明人： Kazuyasu Ohwaki ,  Goh Itoh ,  Nao Mishima

IPC分类号： H04N7/12

CPC分类号： H04N7/014 ,  H04N19/132 ,  H04N19/553 ,  H04N19/573 ,  H04N19/587 ,  H04N19/61

摘要： A method for generating an interpolation frame between first and second reference frames includes dividing an interpolation frame into several interpolation areas; detecting a most correlated combination from several combinations between first reference areas and second reference areas for each interpolation area; obtaining a motion vector from the first and second reference areas; determining whether the first reference areas and the second reference areas are in a high-correlated area or a low-correlated area; giving the motion vector to the motion vector detected area, the motion vector detected area corresponding to the interpolation area which is determined to be the high-correlated area in the first and second reference areas; determining a motion vector to be given to the motion vector undetected area; and generating the interpolation frame based on the motion vector given to the motion vector detected area and the motion vector determined for the motion vector undetected area.

摘要翻译： 一种用于在第一和第二参考帧之间产生插值帧的方法包括：将内插帧划分成若干内插区域; 从每个插值区域的第一参考区域和第二参考区域之间的多个组合中检测最相关的组合; 从所述第一和第二参考区域获得运动矢量; 确定第一参考区域和第二参考区域是否处于高相关区域或低相关区域中; 将所述运动矢量赋予所述运动矢量检测区域，所述运动矢量检测区域对应于被确定为所述第一和第二参考区域中的所述高相关区域的所述内插区域; 确定要给予所述运动矢量未检测区域的运动矢量; 并且基于给予运动矢量检测区域的运动矢量和为运动矢量未检测区域确定的运动矢量生成插值帧。

公开(公告)号：US20060222077A1

公开(公告)日：2006-10-05

申请号：US11368440

申请日：2006-03-07

申请人： Kazuyasu Ohwaki ,  Goh Itoh ,  Nao Mishima

发明人： Kazuyasu Ohwaki ,  Goh Itoh ,  Nao Mishima

IPC分类号： H04N11/02 ,  H04N11/04 ,  H04N7/12 ,  H04B1/66

CPC分类号： H04N7/014 ,  H04N19/132 ,  H04N19/553 ,  H04N19/573 ,  H04N19/587 ,  H04N19/61

摘要： A method for generating an interpolation frame between first and second reference frames includes dividing an interpolation frame into several interpolation areas; detecting a most correlated combination from several combinations between first reference areas and second reference areas for each interpolation area; obtaining a motion vector from the first and second reference areas; determining whether the first reference areas and the second reference areas are in a high-correlated area or a low-correlated area; giving the motion vector to the motion vector detected area, the motion vector detected area corresponding to the interpolation area which is determined to be the high-correlated area in the first and second reference areas; determining a motion vector to be given to the motion vector undetected area; and generating the interpolation frame based on the motion vector given to the motion vector detected area and the motion vector determined for the motion vector undetected area.

摘要翻译： 一种用于在第一和第二参考帧之间产生插值帧的方法包括：将内插帧划分成若干内插区域; 从每个插值区域的第一参考区域和第二参考区域之间的多个组合中检测最相关的组合; 从所述第一和第二参考区域获得运动矢量; 确定第一参考区域和第二参考区域是否处于高相关区域或低相关区域中; 将所述运动矢量赋予所述运动矢量检测区域，所述运动矢量检测区域对应于被确定为所述第一和第二参考区域中的所述高相关区域的所述内插区域; 确定要给予所述运动矢量未检测区域的运动矢量; 并且基于给予运动矢量检测区域的运动矢量和为运动矢量未检测区域确定的运动矢量生成插值帧。