公开(公告)号：US20120113094A1

公开(公告)日：2012-05-10

申请号：US13051571

申请日：2011-03-18

申请人： Kenichi Shimoyama ,  Takeshi Mita ,  Nao Mishima ,  Ryusuke Hirai ,  Masahiro Baba ,  Io Nakayama

发明人： Kenichi Shimoyama ,  Takeshi Mita ,  Nao Mishima ,  Ryusuke Hirai ,  Masahiro Baba ,  Io Nakayama

IPC分类号： G06T15/00

CPC分类号： G06T7/50

摘要： According to an embodiment, an image processing apparatus creates a depth map representing distribution of depths of pixels in an image. The apparatus includes an area detecting unit configured to detect an area of a vertical object included in an image; a base depth adding unit configured to add a base depth to the image, the base depth being a basic distribution of depths of pixels in the image; and, a depth map creating unit configured to acquire at least one depth of a vicinity of a ground contact position of the vertical object from the base depth added to the image, and create the depth map by setting the acquired depth onto the base depth as a depth of the area of the vertical object.

摘要翻译： 根据实施例，图像处理装置创建表示图像中像素深度分布的深度图。 该装置包括：区域检测单元，被配置为检测包括在图像中的垂直对象的区域; 基础深度添加单元，被配置为向所述图像添加基本深度，所述基本深度是所述图像中的像素深度的基本分布; 以及深度图生成单元，被配置为从添加到图像的基础深度获取垂直对象的接地位置的附近的至少一个深度，并且通过将获取的深度设置到基础深度上来创建深度图，作为 垂直物体的区域的深度。

公开(公告)号：US20120019625A1

公开(公告)日：2012-01-26

申请号：US13052793

申请日：2011-03-21

申请人： Nao MISHIMA ,  Takeshi Mita ,  Masahiro Baba

发明人： Nao MISHIMA ,  Takeshi Mita ,  Masahiro Baba

IPC分类号： H04N13/02

CPC分类号： G06T15/205 ,  H04N13/261

摘要： According to one embodiment, a parallax image generation apparatus comprises a calculation unit and a generation unit. The calculation unit is configured to calculate a distance between a target pixel value of a target pixel contained in an input image and a representative pixel value, and calculating a depth of the target pixel in a stereoscopic space in accordance with the distance. The generation unit is configured to generate, based on the depth, at least one parallax image corresponding to a view point different from that of the input image.

摘要翻译： 根据一个实施例，视差图像生成装置包括计算单元和生成单元。 计算单元被配置为计算输入图像中包含的目标像素的目标像素值与代表像素值之间的距离，并且根据该距离计算立体空间中的目标像素的深度。 生成单元被配置为基于深度生成与不同于输入图像的视点相对应的至少一个视差图像。

公开(公告)号：US20120082368A1

公开(公告)日：2012-04-05

申请号：US13181888

申请日：2011-07-13

申请人： Ryusuke HIRAI ,  Nao Mishima ,  Takeshi Mita ,  Masahiro Baba

发明人： Ryusuke HIRAI ,  Nao Mishima ,  Takeshi Mita ,  Masahiro Baba

IPC分类号： G06K9/00

CPC分类号： G06T5/002 ,  G06T5/50 ,  G06T2200/04 ,  G06T2207/10028 ,  G06T2207/20012 ,  G06T2207/20076 ,  G06T2207/20212 ,  H04N13/128

摘要： According to one embodiment, a depth correction apparatus includes a clusterer, a calculator and a corrector. The clusterer is configured to apply clustering to at least one of pixel values and depth values of a plurality of pixels in a calculation range corresponding to a correction target pixel, and to classify the plurality of pixels in the calculation range into a plurality of classes. The calculator is configured to calculate pixel value statistics of the respective classes using pixel values of pixels in the respective classes. The corrector is configured to determine a corresponding class of the correction target pixel based on a pixel value of the correction target pixel and the pixel value statistics of the respective classes, and to apply correction which replaces a depth value of the correction target pixel by a representative depth value of the corresponding class.

摘要翻译： 根据一个实施例，深度校正装置包括聚类器，计算器和校正器。 聚类器被配置为将聚类应用于与校正目标像素相对应的计算范围中的多个像素的像素值和深度值中的至少一个，并将计算范围内的多个像素分类为多个类别。 计算器被配置为使用各个类中的像素的像素值来计算各个类的像素值统计。 校正器被配置为基于校正目标像素的像素值和各个类别的像素值统计来确定校正对象像素的对应类别，并且将修正目标像素的深度值替换为校正对象像素的深度值的校正 相应类的代表性深度值。

公开(公告)号：US20100061651A1

公开(公告)日：2010-03-11

申请号：US12408861

申请日：2009-03-23

申请人： Nao Mishima ,  Kenzo Isogawa ,  Masahiro Baba

发明人： Nao Mishima ,  Kenzo Isogawa ,  Masahiro Baba

IPC分类号： G06K9/40

CPC分类号： G06T5/003 ,  G06T5/20 ,  G06T2207/20008

摘要： A degraded-image restoration method includes inputting a degraded image degraded by a predetermined degradation process; reading from a storage unit a filter coefficient in a filtering process of restoring the degraded image, in which an iteration formula for minimizing a square error between the degraded image and an image obtained by degrading a restored image by the degradation process is expanded corresponding to a predetermined number of iterations; and performing the filtering process using the filter coefficient with respect to the degraded image to obtain a restored image of the degraded image. Accordingly, a throughput in an apparatus that restores the degraded image can be reduced, thereby obtaining a preferable restored image.

摘要翻译： 降级图像恢复方法包括：输入由预定的降级处理降级的退化图像; 从存储单元读取在恢复劣化图像的滤波处理中的滤波器系数，其中通过劣化图像和通过劣化处理降级恢复图像而获得的图像之间的平方误差最小化的迭代公式对应于 预定次数的迭代; 以及使用关于劣化图像的滤波器系数来执行滤波处理，以获得退化图像的恢复图像。 因此，可以减少恢复劣化图像的装置中的吞吐量，从而获得优选的恢复图像。

公开(公告)号：US07440619B2

公开(公告)日：2008-10-21

申请号：US11355144

申请日：2006-02-16

申请人： Nao Mishima ,  Goh Itoh ,  Masahiro Baba

发明人： Nao Mishima ,  Goh Itoh ,  Masahiro Baba

IPC分类号： G06K9/68

CPC分类号： G06K9/6206 ,  G06T3/0093 ,  G06T7/32

摘要： An image matching method includes setting first and second lattices to first and second images respectively, computing potential force to each second lattice point of the second lattice by a gradient of an image correlation potential energy based on a position of each first lattice point and pixel thereof and a position of the second lattice point and pixel thereof, computing elasticity force to the second lattice point from elasticity energy between the second and adjacent lattice points, computing frictional force occurring at the second lattice point, performing a numerical analysis of an equation of motion regarding the second lattice point and based on the potential force, elasticity force and frictional force to obtain a convergence state of the second lattice points, and adding a new lattice point between an adjacent lattice point pair of second lattice points according to a distance between the adjacent lattice point pair.

摘要翻译： 图像匹配方法包括：将第一和第二格点分别设置到第一和第二图像，基于每个第一格点及其像素的位置，通过图像相关势能的梯度计算第二格子的每个第二格点的势力 和第二格子点及其像素的位置，从第二和相邻网格点之间的弹性能量计算第二格子点的弹性力，计算出现在第二格子点处的摩擦力，执行运动方程式的数值分析 关于第二格子点，并且基于潜在力，弹性力和摩擦力来获得第二格子点的会聚状态，并且根据第二格点的相邻格点之间的距离在第二格点之间添加新的格点 相邻晶格点对。

公开(公告)号：US20060193535A1

公开(公告)日：2006-08-31

申请号：US11355144

申请日：2006-02-16

申请人： Nao Mishima ,  Goh Itoh ,  Masahiro Baba

发明人： Nao Mishima ,  Goh Itoh ,  Masahiro Baba

IPC分类号： G06K9/32 ,  G06K9/36

CPC分类号： G06K9/6206 ,  G06T3/0093 ,  G06T7/32

摘要： An image matching method includes setting first and second lattices to first and second images respectively, computing potential force to each second lattice point of the second lattice by a gradient of an image correlation potential energy based on a position of each first lattice point and pixel thereof and a position of the second lattice point and pixel thereof, computing elasticity force to the second lattice point from elasticity energy between the second and adjacent lattice points, computing frictional force occurring at the second lattice point, performing a numerical analysis of an equation of motion regarding the second lattice point and based on the potential force, elasticity force and frictional force to obtain a convergence state of the second lattice points, and adding a new lattice point between an adjacent lattice point pair of second lattice points according to a distance between the adjacent lattice point pair.

公开(公告)号：US20050157792A1

公开(公告)日：2005-07-21

申请号：US11032167

申请日：2005-01-11

申请人： Masahiro Baba ,  Nao Mishima

发明人： Masahiro Baba ,  Nao Mishima

IPC分类号： G06T3/40 ,  G06T7/20 ,  H04N7/01 ,  H04N7/12

CPC分类号： H04N7/014 ,  G06T3/4007 ,  G06T7/20

摘要： An interpolation image generating method includes dividing each of the first reference image and the second reference image into reference regions each including pixels, executing a correlation operation between the first reference image and first destination images located before and after the first reference image and a correlation operation between the second reference image and a second destination image to derive motion vectors for the first and second destination images every reference region, obtaining correlation values between the regions of the first and second destination images that are indicated by the motion vectors and the reference region to determine the reference region as a high or low correlation region, generating an interpolation image candidate between the first reference and second images using the reference region determined as the high correlation region, and mixing the interpolation image candidates using the motion vectors of the reference region to produce an interpolation image.

摘要翻译： 插值图像生成方法包括将第一参考图像和第二参考图像中的每一个分成包括像素的参考区域，执行第一参考图像和位于第一参考图像之前和之后的第一目的地图像之间的相关运算，以及相关运算 在第二参考图像和第二目的地图像之间，以导出每个参考区域的第一和第二目的地图像的运动矢量，获得由运动矢量和参考区域指示的第一和第二目的地图像的区域之间的相关值， 将所述参考区域确定为高相关区域或低相关区域，使用被确定为所述高相关区域的所述参考区域，在所述第一参考图像和所述第二图像之间生成内插图像候选，以及使用所述参考区域的运动矢量将所述内插图像候选 生产 内插图像。

公开(公告)号：US09154764B2

公开(公告)日：2015-10-06

申请号：US13227210

申请日：2011-09-07

申请人： Nao Mishima ,  Takeshi Mita ,  Masahiro Baba

发明人： Nao Mishima ,  Takeshi Mita ,  Masahiro Baba

IPC分类号： G06T1/00 ,  G06T15/00 ,  H04N13/00

CPC分类号： H04N13/128

摘要： According to an embodiment, a map converting method includes calculating existing frequency of depths in a first map, the first map corresponding to at least an image area of an image and each pixel of the first map representing a depth corresponding to a pixel of the image area; and first converting the first map into a second map that represents a depth in a first range for each pixel by using the existing frequency.

摘要翻译： 根据实施例，地图转换方法包括计算第一地图中的深度的现有频率，第一地图对应于图像的至少一个图像区域，第一地图的每个像素表示与图像的像素对应的深度 区; 并且首先通过使用现有频率将第一映射转换成表示每个像素的第一范围内的深度的第二映射。

公开(公告)号：US08761492B2

公开(公告)日：2014-06-24

申请号：US13181888

申请日：2011-07-13

申请人： Ryusuke Hirai ,  Nao Mishima ,  Takeshi Mita ,  Masahiro Baba

发明人： Ryusuke Hirai ,  Nao Mishima ,  Takeshi Mita ,  Masahiro Baba

IPC分类号： G06K9/00 ,  G06K9/62

CPC分类号： G06T5/002 ,  G06T5/50 ,  G06T2200/04 ,  G06T2207/10028 ,  G06T2207/20012 ,  G06T2207/20076 ,  G06T2207/20212 ,  H04N13/128

摘要： According to one embodiment, a depth correction apparatus includes a clusterer, a calculator and a corrector. The clusterer is configured to apply clustering to at least one of pixel values and depth values of a plurality of pixels in a calculation range corresponding to a correction target pixel, and to classify the plurality of pixels in the calculation range into a plurality of classes. The calculator is configured to calculate pixel value statistics of the respective classes using pixel values of pixels in the respective classes. The corrector is configured to determine a corresponding class of the correction target pixel based on a pixel value of the correction target pixel and the pixel value statistics of the respective classes, and to apply correction which replaces a depth value of the correction target pixel by a representative depth value of the corresponding class.

摘要翻译： 根据一个实施例，深度校正装置包括聚类器，计算器和校正器。 聚类器被配置为将聚类应用于与校正目标像素相对应的计算范围中的多个像素的像素值和深度值中的至少一个，并将计算范围内的多个像素分类为多个类别。 计算器被配置为使用各个类中的像素的像素值来计算各个类的像素值统计。 校正器被配置为基于校正目标像素的像素值和各个类别的像素值统计来确定校正对象像素的对应类别，并且将修正目标像素的深度值替换为校正对象像素的深度值的校正 相应类的代表性深度值。

公开(公告)号：US20090079836A1

公开(公告)日：2009-03-26

申请号：US12235108

申请日：2008-09-22

申请人： Nao Mishima ,  Yasutoyo Takeyama ,  Masahiro Baba ,  Goh Itoh

发明人： Nao Mishima ,  Yasutoyo Takeyama ,  Masahiro Baba ,  Goh Itoh

IPC分类号： G06K9/32 ,  H04N5/228

CPC分类号： H04N5/262 ,  G06T3/4007 ,  G06T5/004 ,  G06T7/231 ,  G06T2207/10016 ,  G06T2207/20201 ,  H04N5/23254 ,  H04N5/772 ,  H04N5/781 ,  H04N5/85

摘要： An image processing apparatus includes a correction-amount calculating unit that calculates a motion-blur correction amount, which takes a larger value as the reproduction speed becomes lower, based on an input reproduction speed; a motion-blur correcting unit that performs scale transformation on a motion vector based on the motion-blur correction amount, acquires low frequency components of a source image and a destination image using an anisotropic Gaussian filter determined by a direction and a size of the motion vector subjected to the scale transformation, and performs edge enhancement on the source image and the destination image based on the low frequency components and high frequency components of the source image and the destination image; and an interpolation-image creating unit that creates the interpolation image using the source image for which the motion blur is corrected, the destination image for which the motion blur is corrected, and the motion vector.

摘要翻译： 一种图像处理装置，包括校正量计算单元，其基于输入的再现速度来计算随着再现速度变低的变化而获得较大值的运动模糊校正量; 使用基于运动模糊校正量对运动矢量执行缩放变换的运动模糊校正单元，使用由运动的方向和尺寸确定的各向异性高斯滤波器来获取源图像和目的地图像的低频分量 进行缩放变换的矢量，并且基于源图像和目的图像的低频分量和高频分量对源图像和目的图像执行边缘增强; 以及内插图像生成单元，其使用校正了运动模糊的源图像，校正运动模糊的目的地图像和运动矢量来生成插值图像。