公开(公告)号：US08130840B2

公开(公告)日：2012-03-06

申请号：US12408424

申请日：2009-03-20

申请人： Nao Mishima ,  Ryusuke Hirai ,  Yasutoyo Takeyama ,  Goh Itoh

发明人： Nao Mishima ,  Ryusuke Hirai ,  Yasutoyo Takeyama ,  Goh Itoh

IPC分类号： H04N7/12

CPC分类号： H04N5/144 ,  G06T3/4007 ,  H04N19/117 ,  H04N19/132 ,  H04N19/139 ,  H04N19/51 ,  H04N19/521 ,  H04N19/527 ,  H04N19/577 ,  H04N19/587

摘要： An interpolated image generating apparatus calculates a motion vector reliability level indicating reliability of a motion vector used for inserting an interpolated image, the value of the motion vector reliability level being determined in such a manner that the stronger the correlation is between a source image area and a destination image area that are brought into correspondence with each other by the motion vector, the larger is the value. The apparatus also calculates a failure-preventing vector reliability level indicating reliability of a predetermined failure-preventing vector used for preventing image failures. The apparatus obtains a motion compensated image based on the motion vector, obtains a failure-preventing image based on the failure-preventing vector, and blends the motion compensated image and the failure-preventing image according to a weighted average thereof calculated by using a weighting factor based on the motion vector reliability level and the failure-preventing vector reliability level.

摘要翻译： 内插图像生成装置计算表示用于插入内插图像的运动矢量的可靠性的运动矢量可靠度水平，运动矢量可靠性水平的值被确定为使源图像区域和源图像区域之间的相关性越强 通过运动矢量相互对应的目的地图像区域的值越大。 该装置还计算表示用于防止图像故障的预定故障防止向量的可靠性的防故障向量可靠性水平。 该装置基于运动矢量获得运动补偿图像，基于防故障向量获得防故障图像，并且根据通过使用加权来计算的加权平均值来混合运动补偿图像和防故障图像 基于运动矢量可靠度水平和防故障矢量可靠性水平的因子。

公开(公告)号：US20090244389A1

公开(公告)日：2009-10-01

申请号：US12408424

申请日：2009-03-20

申请人： Nao Mishima ,  Ryusuke Hirai ,  Yasutoyo Takeyama ,  Goh Itoh

发明人： Nao Mishima ,  Ryusuke Hirai ,  Yasutoyo Takeyama ,  Goh Itoh

IPC分类号： H04N5/14 ,  G06K9/32

CPC分类号： H04N5/144 ,  G06T3/4007 ,  H04N19/117 ,  H04N19/132 ,  H04N19/139 ,  H04N19/51 ,  H04N19/521 ,  H04N19/527 ,  H04N19/577 ,  H04N19/587

摘要： An interpolated image generating apparatus calculates a motion vector reliability level indicating reliability of a motion vector used for inserting an interpolated image, the value of the motion vector reliability level being determined in such a manner that the stronger the correlation is between a source image area and a destination image area that are brought into correspondence with each other by the motion vector, the larger is the value. The apparatus also calculates a failure-preventing vector reliability level indicating reliability of a predetermined failure-preventing vector used for preventing image failures. The apparatus obtains a motion compensated image based on the motion vector, obtains a failure-preventing image based on the failure-preventing vector, and blends the motion compensated image and the failure-preventing image according to a weighted average thereof calculated by using a weighting factor based on the motion vector reliability level and the failure-preventing vector reliability level.

摘要翻译： 内插图像生成装置计算表示用于插入内插图像的运动矢量的可靠性的运动矢量可靠度水平，运动矢量可靠性水平的值被确定为使源图像区域和源图像区域之间的相关性越强 通过运动矢量相互对应的目的地图像区域的值越大。 该装置还计算表示用于防止图像故障的预定故障防止向量的可靠性的防故障向量可靠性水平。 该装置基于运动矢量获得运动补偿图像，基于防故障向量获得防故障图像，并且根据通过使用加权来计算的加权平均值来混合运动补偿图像和防故障图像 基于运动矢量可靠度水平和防故障矢量可靠性水平的因子。

公开(公告)号：US20100054606A1

公开(公告)日：2010-03-04

申请号：US12544356

申请日：2009-08-20

申请人： Nao Mishima ,  Kenzo Isogawa ,  Ryusuke Hirai ,  Goh Itoh

发明人： Nao Mishima ,  Kenzo Isogawa ,  Ryusuke Hirai ,  Goh Itoh

IPC分类号： G06K9/32

CPC分类号： G06T7/13

摘要： An image processing apparatus includes an operating unit that calculates a tangent-line direction of an edge and a normal-line direction of the edge by using a vertical-direction derivative value and a horizontal-direction derivative value of a pixel value of a pixel in an input image; a converting unit that converts local coordinates positioned within a predetermined area with respect to a target pixel in the input image into rotated coordinates, by rotating the local coordinates according to an angle formed by the horizontal direction and the tangent-line direction of the edge; and a fitting unit that performs, at the rotated coordinates, a fitting process that employs a least-squares method by using a curved-plane model expressed with the pixel value of the target pixel in the input image.

摘要翻译： 图像处理装置包括：操作单元，其通过使用垂直方向导数值和像素的像素值的水平方向导数值来计算边缘的切线方向和边缘的法线方向 输入图像; 转换单元，通过根据由边缘的水平方向和切线方向形成的角度旋转局部坐标，将位于输入图像中的目标像素的预定区域内的局部坐标转换为旋转坐标; 以及拟合单元，其通过使用由输入图像中的目标像素的像素值表示的曲面模型，以旋转的坐标进行采用最小二乘法的拟合处理。

公开(公告)号：US20110205235A1

公开(公告)日：2011-08-25

申请号：US13061270

申请日：2009-08-28

申请人： Nao Mishima ,  Kenzo Isogawa ,  Ryusuke Hirai ,  Goh Itoh

发明人： Nao Mishima ,  Kenzo Isogawa ,  Ryusuke Hirai ,  Goh Itoh

IPC分类号： G09G5/00 ,  G06K9/36

CPC分类号： G06T7/0085 ,  G06T7/13

摘要： An image processing apparatus includes an operating unit configured to calculate a tangent-line direction of an edge and a normal-line direction of the edge by using a vertical-direction derivative value and a horizontal-direction derivative value of a pixel value of a pixel in an input image; a converting unit configured to convert local coordinates positioned within a predetermined area with respect to a target pixel in the input image into rotated coordinates, by rotating the local coordinates according to an angle formed by the horizontal direction and the tangent-line direction of the edge; and a fitting unit configured to perform, at the rotated coordinates, a fitting process that employs a least-squares method by using a curved surface model expressed with the pixel value of the target pixel in the input image.

摘要翻译： 一种图像处理装置，包括操作单元，其被配置为通过使用垂直方向导数值和像素的像素值的水平方向导数值来计算边缘的切线方向和边缘的法线方向 在输入图像中; 转换单元，被配置为通过根据由水平方向和边缘的切线方向形成的角度旋转局部坐标，将位于输入图像中的目标像素的预定区域内的局部坐标转换为旋转坐标 ; 以及装配单元，被配置为在旋转的坐标处执行使用通过使用由输入图像中的目标像素的像素值表示的曲面模型而采用最小二乘法的拟合处理。

公开(公告)号：US09092870B2

公开(公告)日：2015-07-28

申请号：US13061270

申请日：2009-08-28

申请人： Nao Mishima ,  Kenzo Isogawa ,  Ryusuke Hirai ,  Goh Itoh

发明人： Nao Mishima ,  Kenzo Isogawa ,  Ryusuke Hirai ,  Goh Itoh

IPC分类号： G09G5/00 ,  G06T7/00

CPC分类号： G06T7/0085 ,  G06T7/13

摘要： An image processing apparatus includes an operating unit configured to calculate a tangent-line direction of an edge and a normal-line direction of the edge by using a vertical-direction derivative value and a horizontal-direction derivative value of a pixel value of a pixel in an input image; a converting unit configured to convert local coordinates positioned within a predetermined area with respect to a target pixel in the input image into rotated coordinates, by rotating the local coordinates according to an angle formed by the horizontal direction and the tangent-line direction of the edge; and a fitting unit configured to perform, at the rotated coordinates, a fitting process that employs a least-squares method by using a curved surface model expressed with the pixel value of the target pixel in the input image.

摘要翻译： 一种图像处理装置，包括：操作单元，被配置为通过使用垂直方向导数值和像素的像素值的水平方向导数值来计算边缘的切线方向和边缘的法线方向 在输入图像中; 转换单元，被配置为通过根据由水平方向和边缘的切线方向形成的角度旋转局部坐标，将位于输入图像中的目标像素的预定区域内的局部坐标转换为旋转坐标 ; 以及装配单元，被配置为在旋转的坐标处执行使用通过使用由输入图像中的目标像素的像素值表示的曲面模型而采用最小二乘法的拟合处理。

公开(公告)号：US08665319B2

公开(公告)日：2014-03-04

申请号：US12888582

申请日：2010-09-23

申请人： Nao Mishima ,  Takeshi Mita ,  Kenichi Shimoyama ,  Ryusuke Hirai ,  Masahiro Baba

发明人： Nao Mishima ,  Takeshi Mita ,  Kenichi Shimoyama ,  Ryusuke Hirai ,  Masahiro Baba

IPC分类号： H04N13/02

CPC分类号： G06T5/002 ,  G06T2207/10012 ,  G06T2207/10028 ,  H04N13/128 ,  H04N13/275

摘要： According to one embodiment, a parallax image generating apparatus is for generating, using a first image, a parallax images with a parallax therebetween. The apparatus includes following units. The first estimation unit estimates distribution information items indicating distributions of first depths in the first image by using first methods. The distribution information items falls within a depth range to be reproduced. The first combination unit combines the distribution information items to generate first depth information. The second calculation unit calculates second depth information indicating relative unevenness of an object in the first image. The third combination unit combines the first depth information and the second depth information by using a method different from the first methods, to generate third depth information. The generation unit generates the parallax images based on the third depth information and the first image.

摘要翻译： 根据一个实施例，视差图像生成装置用于使用第一图像生成其间具有视差的视差图像。 该装置包括以下单元。 第一估计单元通过使用第一方法估计指示第一图像中的第一深度的分布的分布信息项。 分发信息项落在要再现的深度范围内。 第一组合单元组合分配信息项以产生第一深度信息。 第二计算单元计算指示第一图像中的物体的相对不均匀性的第二深度信息。 第三组合单元通过使用与第一方法不同的方法组合第一深度信息和第二深度信息，以产生第三深度信息。 生成单元基于第三深度信息和第一图像生成视差图像。

公开(公告)号：US08761492B2

公开(公告)日：2014-06-24

申请号：US13181888

申请日：2011-07-13

申请人： Ryusuke Hirai ,  Nao Mishima ,  Takeshi Mita ,  Masahiro Baba

发明人： Ryusuke Hirai ,  Nao Mishima ,  Takeshi Mita ,  Masahiro Baba

IPC分类号： G06K9/00 ,  G06K9/62

CPC分类号： G06T5/002 ,  G06T5/50 ,  G06T2200/04 ,  G06T2207/10028 ,  G06T2207/20012 ,  G06T2207/20076 ,  G06T2207/20212 ,  H04N13/128

摘要： According to one embodiment, a depth correction apparatus includes a clusterer, a calculator and a corrector. The clusterer is configured to apply clustering to at least one of pixel values and depth values of a plurality of pixels in a calculation range corresponding to a correction target pixel, and to classify the plurality of pixels in the calculation range into a plurality of classes. The calculator is configured to calculate pixel value statistics of the respective classes using pixel values of pixels in the respective classes. The corrector is configured to determine a corresponding class of the correction target pixel based on a pixel value of the correction target pixel and the pixel value statistics of the respective classes, and to apply correction which replaces a depth value of the correction target pixel by a representative depth value of the corresponding class.

摘要翻译： 根据一个实施例，深度校正装置包括聚类器，计算器和校正器。 聚类器被配置为将聚类应用于与校正目标像素相对应的计算范围中的多个像素的像素值和深度值中的至少一个，并将计算范围内的多个像素分类为多个类别。 计算器被配置为使用各个类中的像素的像素值来计算各个类的像素值统计。 校正器被配置为基于校正目标像素的像素值和各个类别的像素值统计来确定校正对象像素的对应类别，并且将修正目标像素的深度值替换为校正对象像素的深度值的校正 相应类的代表性深度值。

公开(公告)号：US20110242280A1

公开(公告)日：2011-10-06

申请号：US12888582

申请日：2010-09-23

申请人： Nao Mishima ,  Takeshi Mita ,  Kenichi Shimoyama ,  Ryusuke Hirai ,  Masahiro Baba

发明人： Nao Mishima ,  Takeshi Mita ,  Kenichi Shimoyama ,  Ryusuke Hirai ,  Masahiro Baba

IPC分类号： H04N13/02

CPC分类号： G06T5/002 ,  G06T2207/10012 ,  G06T2207/10028 ,  H04N13/128 ,  H04N13/275

摘要： According to one embodiment, a parallax image generating apparatus is for generating, using a first image, a parallax images with a parallax therebetween. The apparatus includes following units. The first estimation unit estimates distribution information items indicating distributions of first depths in the first image by using first methods. The distribution information items falls within a depth range to be reproduced. The first combination unit combines the distribution information items to generate first depth information. The second calculation unit calculates second depth information indicating relative unevenness of an object in the first image. The third combination unit combines the first depth information and the second depth information by using a method different from the first methods, to generate third depth information. The generation unit generates the parallax images based on the third depth information and the first image.

摘要翻译： 根据一个实施例，视差图像生成装置用于使用第一图像生成其间具有视差的视差图像。 该装置包括以下单元。 第一估计单元通过使用第一方法估计指示第一图像中的第一深度的分布的分布信息项。 分发信息项落在要再现的深度范围内。 第一组合单元组合分配信息项以产生第一深度信息。 第二计算单元计算指示第一图像中的物体的相对不均匀性的第二深度信息。 第三组合单元通过使用与第一方法不同的方法组合第一深度信息和第二深度信息，以产生第三深度信息。 生成单元基于第三深度信息和第一图像生成视差图像。

公开(公告)号：US08805020B2

公开(公告)日：2014-08-12

申请号：US13052194

申请日：2011-03-21

申请人： Takeshi Mita ,  Nao Mishima ,  Kenichi Shimoyama ,  Ryusuke Hirai

发明人： Takeshi Mita ,  Nao Mishima ,  Kenichi Shimoyama ,  Ryusuke Hirai

IPC分类号： G06K9/00 ,  G06K9/46 ,  G06K9/66 ,  G06K9/20 ,  G06K9/36 ,  H04N15/00 ,  H04N13/00 ,  G06T15/00 ,  G06T7/00 ,  G06T7/40

CPC分类号： G06K9/4642 ,  G06K9/00697 ,  G06K9/00704 ,  G06K9/6269 ,  G06T7/50 ,  G06T7/80 ,  G06T7/90 ,  G06T2207/10016 ,  G06T2207/10028 ,  G06T2207/20021 ,  H04N13/261

摘要： According to one embodiment, a depth signal generating apparatus includes following units. The calculating unit is configured to calculate a statistic value for pixel values for each of predefined areas in the first image, and calculate, for each of predetermined base depth models, a first evaluation value based on the calculated statistic value. The correcting unit is configured to correct, based on a second evaluation value previously derived for the second image and a first degree of similarity indicating a similarity between the predetermined base depth models, the first evaluation value to derive second evaluation values for the predetermined base depth models. The selecting unit is configured to select a base depth model having the highest second evaluation value from the predetermined base depth models. The generating unit is configured to generate a depth signal based on the selected base depth model.

摘要翻译： 根据一个实施例，深度信号发生装置包括以下单元。 计算单元被配置为计算第一图像中的每个预定区域的像素值的统计值，并且针对每个预定基础深度模型，基于所计算的统计值来计算第一评估值。 校正单元被配置为基于先前为第二图像导出的第二评估值和指示预定基准深度模型之间的相似度的第一相似程度来校正第一评估值，以获得预定基础深度的第二评估值 楷模。 选择单元被配置为从预定的基本深度模型中选择具有最高的第二评估值的基础深度模型。 生成单元被配置为基于所选择的基础深度模型生成深度信号。

公开(公告)号：US20120162223A1

公开(公告)日：2012-06-28

申请号：US13409213

申请日：2012-03-01

申请人： Ryusuke Hirai ,  Hidenori Takeshima ,  Takeshi Mita ,  Nao Mishima ,  Kenichi Shimoyama ,  Takashi Ida

发明人： Ryusuke Hirai ,  Hidenori Takeshima ,  Takeshi Mita ,  Nao Mishima ,  Kenichi Shimoyama ,  Takashi Ida

IPC分类号： G06T15/00

CPC分类号： G06T3/4007 ,  H04N13/106 ,  H04N13/128 ,  H04N13/261 ,  H04N2013/0081

摘要： According to one embodiment, a parallax image generating apparatus includes a deriving unit, a generating unit, a first calculating unit, a setting unit, a searching unit, and an interpolating unit. The deriving unit derives a parallax vector corresponding to a first pixel from the input image and depth information associated with the first pixel. The generating unit generates an intermediate image. The first calculating unit calculates first weights for respective pixels of a parallax image. The setting unit sets one or more candidate blocks near a shade-forming-area pixel of the intermediate image, and sets a reference block among one or more candidate blocks. The searching unit searches a target block similar to the reference block in the input image and/or the intermediate image. The interpolating unit interpolates a pixel value of the shade-forming-area pixel.

摘要翻译： 根据一个实施例，视差图像生成装置包括导出单元，生成单元，第一计算单元，设置单元，搜索单元和内插单元。 导出单元从输入图像中导出对应于第一像素的视差矢量和与第一像素相关联的深度信息。 生成单元生成中间图像。 第一计算单元计算视差图像的各个像素的第一权重。 设置单元在中间图像的阴影形成区域像素附近设置一个或多个候选块，并且在一个或多个候选块中设置参考块。 搜索单元在输入图像和/或中间图像中搜索与参考块类似的目标块。 内插单元内插色调形成区域像素的像素值。