公开(公告)号：US08682060B2

公开(公告)日：2014-03-25

申请号：US13049620

申请日：2011-03-16

申请人： Nao Mishima ,  Takeshi Mita

发明人： Nao Mishima ,  Takeshi Mita

IPC分类号： G06K9/00 ,  G06K9/62 ,  G01C3/14 ,  G02B27/22

CPC分类号： G06T7/254

摘要： According to one embodiment, an image processing method includes calculating an activity value for a first block, the activity value indicating a higher degree of activity as pixel values vary in a greater degree in the first block, and calculating a first evaluation value that indicates higher evaluation as a difference between a pixel value of the first block and a pixel value of a second block is smaller. The method further includes calculating a second evaluation value that indicates higher evaluation as correlation between a relative spatial relationship of the pixel value of the first block and that of the pixel value of the second block is higher, and calculating a third evaluation value by weighting the first evaluation value and the second evaluation value to search for the second block that corresponds to the first block, a weight of the first evaluation value is larger as the activity value is larger.

摘要翻译： 根据一个实施例，一种图像处理方法包括：计算第一块的活动值，所述活动值指示在第一块中像素值在较大程度上变化的较高活动度，并且计算指示较高的第一评估值 作为第一块的像素值和第二块的像素值之间的差的评估较小。 该方法还包括计算表示较高评估的第二评估值，作为第一块的像素值与第二块的像素值的相对空间关系之间的相关性较高，并且通过对第 第一评估值和第二评估值，以搜索对应于第一块的第二块，则第一评估值的权重随着活动值较大而较大。

公开(公告)号：US08665319B2

公开(公告)日：2014-03-04

申请号：US12888582

申请日：2010-09-23

申请人： Nao Mishima ,  Takeshi Mita ,  Kenichi Shimoyama ,  Ryusuke Hirai ,  Masahiro Baba

发明人： Nao Mishima ,  Takeshi Mita ,  Kenichi Shimoyama ,  Ryusuke Hirai ,  Masahiro Baba

IPC分类号： H04N13/02

CPC分类号： G06T5/002 ,  G06T2207/10012 ,  G06T2207/10028 ,  H04N13/128 ,  H04N13/275

摘要： According to one embodiment, a parallax image generating apparatus is for generating, using a first image, a parallax images with a parallax therebetween. The apparatus includes following units. The first estimation unit estimates distribution information items indicating distributions of first depths in the first image by using first methods. The distribution information items falls within a depth range to be reproduced. The first combination unit combines the distribution information items to generate first depth information. The second calculation unit calculates second depth information indicating relative unevenness of an object in the first image. The third combination unit combines the first depth information and the second depth information by using a method different from the first methods, to generate third depth information. The generation unit generates the parallax images based on the third depth information and the first image.

摘要翻译： 根据一个实施例，视差图像生成装置用于使用第一图像生成其间具有视差的视差图像。 该装置包括以下单元。 第一估计单元通过使用第一方法估计指示第一图像中的第一深度的分布的分布信息项。 分发信息项落在要再现的深度范围内。 第一组合单元组合分配信息项以产生第一深度信息。 第二计算单元计算指示第一图像中的物体的相对不均匀性的第二深度信息。 第三组合单元通过使用与第一方法不同的方法组合第一深度信息和第二深度信息，以产生第三深度信息。 生成单元基于第三深度信息和第一图像生成视差图像。

公开(公告)号：US20130258057A1

公开(公告)日：2013-10-03

申请号：US13666194

申请日：2012-11-01

申请人： Nao MISHIMA ,  Takeshi Mita

发明人： Nao MISHIMA ,  Takeshi Mita

IPC分类号： H04N13/02

CPC分类号： G02B27/2214 ,  H04N13/305 ,  H04N13/317 ,  H04N13/349

摘要： According to an image processing device includes an acquiring unit and a correcting unit. The acquiring unit is configured to acquire a stereoscopic image containing a plurality of parallax images each having a mutually different parallax. The correcting unit is configured to perform, for each pixel of the stereoscopic image, correction to set a parallax number of a parallax image viewed at a viewpoint position to a first parallax number of a parallax image to be viewed at the viewpoint position by using correction data representing a difference value between the first parallax number and a second parallax number of a parallax image that is actually viewed at the viewpoint position and on which distortion correction for correcting distortion of light beams has been performed.

摘要翻译： 根据图像处理装置包括获取单元和校正单元。 获取单元被配置为获取包含具有彼此不同的视差的多个视差图像的立体图像。 校正单元被配置为对于立体图像的每个像素执行校正，以通过使用校正将在视点位置处观看的视差图像的视差编号设置为在视点位置观看的视差图像的第一视差编号 表示在视点位置上实际观看的视差图像的第一视差数和第二视差编号之间的差值的数据，并且进行用于校正光束失真的失真校正。

公开(公告)号：US20120169844A1

公开(公告)日：2012-07-05

申请号：US13415381

申请日：2012-03-08

申请人： Nao MISHIMA ,  Kenichi Shimoyama ,  Takeshi Mita ,  Takashi Ida

发明人： Nao MISHIMA ,  Kenichi Shimoyama ,  Takeshi Mita ,  Takashi Ida

IPC分类号： H04N13/04

CPC分类号： G06T7/97 ,  H04N13/221

摘要： An image processing method for creating a disparity image for 3D display from a 2D video image includes detecting based on a first image of the 2D video image in a time and a second image in a time different from the first image, motion vectors between the first and second images for each block of the first image, detecting from the motion vectors, a most backward vector of a portion whose depth is on the back side, calculating differential vectors between each motion vector and the most backward vector and giving a depth on a close to the block of the first image corresponding to the motion vector having the larger differential vector and creating one or more disparity images from the first image and the depth.

摘要翻译： 一种用于从2D视频图像创建用于3D显示的视差图像的图像处理方法包括：在与第一图像不同的时间内基于2D视频图像的第一图像和第二图像的检测，第一图像与第一图像之间的运动矢量 以及第一图像的每个块的第二图像，从运动矢量检测深度在背面的部分的最后向量，计算每个运动矢量与最后向矢量之间的差分向量，并且在 靠近与具有较大差分矢量的运动矢量对应的第一图像的块，并且从第一图像和深度创建一个或多个视差图像。

公开(公告)号：US08189104B2

公开(公告)日：2012-05-29

申请号：US11687080

申请日：2007-03-16

申请人： Kazuyasu Ohwaki ,  Yasutoyo Takeyama ,  Goh Itoh ,  Nao Mishima

发明人： Kazuyasu Ohwaki ,  Yasutoyo Takeyama ,  Goh Itoh ,  Nao Mishima

IPC分类号： H04N11/20

CPC分类号： H04N5/144 ,  G06T3/4007 ,  H04N7/014

摘要： An apparatus for creating an interpolation frame includes a first computing unit that computes a first motion vector in relation to a first block in a first reference frame, a second extracting unit that extracts a second block in a second reference frame based on the first motion vector, a first calculating unit that calculates a correlation between the first block and the second block, a third extracting unit that extracts a third block that is shifted from the second block by a certain number of pixels, a second calculating unit that calculates a correlation between the first block and the third block, and a third computing unit that computes a motion vector for an interpolation block based on a most-highly correlated block-pair.

摘要翻译： 一种用于创建内插帧的装置包括：第一计算单元，其计算关于第一参考帧中的第一块的第一运动矢量;第二提取单元，其基于第一运动矢量提取第二参考帧中的第二块 计算第一块和第二块之间的相关性的第一计算单元，提取从第二块移位了一定数量的像素的第三块的第三提取单元，计算第一块和第二块之间的相关性的第二计算单元， 第一块和第三块，以及第三计算单元，其基于最高关联块对来计算用于插值块的运动矢量。

公开(公告)号：US08144777B2

公开(公告)日：2012-03-27

申请号：US11686457

申请日：2007-03-15

申请人： Goh Itoh ,  Nao Mishima ,  Haruhiko Okumura

发明人： Goh Itoh ,  Nao Mishima ,  Haruhiko Okumura

IPC分类号： H04N7/12 ,  H04N11/02 ,  H04N11/04

CPC分类号： H04N5/145 ,  H04N19/51 ,  H04N19/521 ,  H04N19/533 ,  H04N19/573 ,  H04N19/577

摘要： A motion vector detection method includes extracting a first block from the m-th picture, extracting second blocks having a large correlation with respect to the first block from a (m+n)-th picture ((m+n)>m-th), detecting first motion vectors between the first and second blocks, extracting a third block located in spatially the same position as that of the first block from a (m+i)-th picture ((m+n)>(m+i)>m-th), computing second motion vectors of (n−1)/n times the first motion vectors, extracting a fourth block corresponding to a movement position of the third block from the (m+n)-th picture according to the second motion vector, and selecting an optimum motion vector maximizing a correlation between the third and fourth blocks from the first motion vectors.

摘要翻译： 运动矢量检测方法包括从第m图像中提取第一块，从第（m + n）个图像（（m + n）> m-th）提取相对于第一块具有较大相关性的第二块 ），检测第一和第二块之间的第一运动矢量，从第（m + i）个图像（（m + n）>（m + i）>（m + i））中提取位于空间上与第一块相同位置的第三块 ）m），计算第一运动矢量的第（n-1）/ n倍的第二运动矢量，根据第（m + n）个图像提取与第三块的移动位置相对应的第四块 并且从所述第一运动矢量中选择最大化所述第三和第四块之间的相关性的最佳运动矢量。

公开(公告)号：US20120008855A1

公开(公告)日：2012-01-12

申请号：US13052937

申请日：2011-03-21

申请人： Ryusuke HIRAI ,  Takeshi MITA ,  Nao MISHIMA ,  Kenichi SHIMOYAMA ,  Masahiro BABA

发明人： Ryusuke HIRAI ,  Takeshi MITA ,  Nao MISHIMA ,  Kenichi SHIMOYAMA ,  Masahiro BABA

IPC分类号： G06K9/00

CPC分类号： H04N13/117

摘要： According to embodiments, a stereoscopic image generation apparatus for generating a disparity image based on at least one image and depth information corresponding to the at least one image is provided. The apparatus includes a calculator, selector and generator. The calculator calculates, based on the depth information, evaluation values that assume larger values with increasing hidden surface regions generated upon generation of disparity images for respective viewpoint sets each including two or more viewpoints. The selector selects one of the viewpoint sets based on the evaluation values calculated for the viewpoint sets. The generator generates, from the at least one image and the depth information, the disparity image at a viewpoint corresponding to the one of the viewpoint sets selected by the selector.

摘要翻译： 根据实施例，提供了一种立体图像生成装置，用于基于至少一个图像生成视差图像，并且提供与至少一个图像相对应的深度信息。 该装置包括计算器，选择器和发生器。 计算器基于深度信息，根据产生每个包括两个或更多个视点的各个视点集的视差图像产生的增加的隐藏表面区域而计算出较大值的评估值。 选择器基于针对视点集计算的评估值来选择视点集合中的一个。 发生器从与该选择器所选择的一个视点集相对应的视点从该至少一个图像和深度信息生成视差图像。

公开(公告)号：US08019123B2

公开(公告)日：2011-09-13

申请号：US12048887

申请日：2008-03-14

申请人： Nao Mishima ,  Goh Itoh

发明人： Nao Mishima ,  Goh Itoh

IPC分类号： G06K9/00

CPC分类号： G06T7/238

摘要： An estimation unit calculates an estimated motion vector between a first source region of a plurality of source regions and a first destination region on a destination picture. The first destination region has the highest correlation with the first source region. A weight calculation unit searches a plurality of second destination regions. Each second destination region is pointed by the estimated motion vector of another source region adjacent to the first source region. The weight calculation unit extracts pixel values of each second destination region, calculates a difference of pixel values between the first source region and each second destination region, and calculates a weight based on the difference. The weight is smaller if the difference is larger. A filtering unit calculates a motion vector of the first source region by averaging the estimated motion vectors with the weight.

摘要翻译： 估计单元计算多个源区域的第一源区域和目的地图像上的第一目的地区域之间的估计运动矢量。 第一目的地区域与第一源区域的相关性最高。 权重计算单元搜索多个第二目的地区域。 每个第二目的地区域由与第一源区域相邻的另一源区域的估计的运动矢量指向。 权重计算单元提取每个第二目的地区域的像素值，计算第一源区域和每个第二目的地区域之间的像素值的差异，并且基于该差异来计算权重。 如果差值较大，重量较小。 滤波单元通过对具有权重的估计运动矢量进行平均来计算第一源区域的运动矢量。

公开(公告)号：US07899122B2

公开(公告)日：2011-03-01

申请号：US11368440

申请日：2006-03-07

申请人： Kazuyasu Ohwaki ,  Goh Itoh ,  Nao Mishima

发明人： Kazuyasu Ohwaki ,  Goh Itoh ,  Nao Mishima

IPC分类号： H04N7/12

CPC分类号： H04N7/014 ,  H04N19/132 ,  H04N19/553 ,  H04N19/573 ,  H04N19/587 ,  H04N19/61

摘要： A method for generating an interpolation frame between first and second reference frames includes dividing an interpolation frame into several interpolation areas; detecting a most correlated combination from several combinations between first reference areas and second reference areas for each interpolation area; obtaining a motion vector from the first and second reference areas; determining whether the first reference areas and the second reference areas are in a high-correlated area or a low-correlated area; giving the motion vector to the motion vector detected area, the motion vector detected area corresponding to the interpolation area which is determined to be the high-correlated area in the first and second reference areas; determining a motion vector to be given to the motion vector undetected area; and generating the interpolation frame based on the motion vector given to the motion vector detected area and the motion vector determined for the motion vector undetected area.

摘要翻译： 一种用于在第一和第二参考帧之间产生插值帧的方法包括：将内插帧划分成若干内插区域; 从每个插值区域的第一参考区域和第二参考区域之间的多个组合中检测最相关的组合; 从所述第一和第二参考区域获得运动矢量; 确定第一参考区域和第二参考区域是否处于高相关区域或低相关区域中; 将所述运动矢量赋予所述运动矢量检测区域，所述运动矢量检测区域对应于被确定为所述第一和第二参考区域中的所述高相关区域的所述内插区域; 确定要给予所述运动矢量未检测区域的运动矢量; 并且基于给予运动矢量检测区域的运动矢量和为运动矢量未检测区域确定的运动矢量生成插值帧。

公开(公告)号：US20100232697A1

公开(公告)日：2010-09-16

申请号：US12560838

申请日：2009-09-16

申请人： Nao Mishima ,  Goh Itoh

发明人： Nao Mishima ,  Goh Itoh

IPC分类号： G06K9/00

CPC分类号： G06K9/4647 ,  G06K9/6212 ,  G06T5/002 ,  G06T5/20 ,  G06T5/40 ,  G06T2207/20012 ,  G06T2207/20192 ,  H04N19/61 ,  H04N19/86

摘要： An image processing apparatus includes a gradient calculator that calculates a direction and a magnitude of a gradient of each pixel in an input image using neighboring pixel values; a histogram calculator that calculates a Histogram of Oriented Gradients containing plural sampled directions from the directions and the magnitudes of the gradients calculated for the pixels in a region including the pixel being processed; a storing unit that stores plural smoothing filters and associated Histograms of Oriented Gradients; a search unit that calculates errors between Histogram of Oriented Gradients calculated for the pixel being processed and the Histograms of Oriented Gradients stored in the storing unit and searches the Histogram of Oriented Gradients that has the minimum error; and a filter processing unit that acquires one of the smoothing filters stored in association with the Histogram of Oriented Gradients having the minimum error and determines a corrected pixel value of the pixel being processed by filter processing with the acquired smoothing filter.

摘要翻译： 一种图像处理装置，包括：梯度计算器，使用相邻像素值计算输入图像中每个像素的梯度的方向和幅度; 直方图计算器，其从包括正在处理的像素的区域中的像素计算的方向和梯度的大小计算包含多个取样方向的定向梯度的直方图; 存储单元，其存储多个平滑滤波器和相关联的定向梯度的直方图; 搜索单元，其计算针对正被处理的像素计算的定向梯度的直方图和存储在存储单元中的定向梯度的直方图之间的误差，并搜索具有最小误差的定向梯度的直方图; 以及滤波处理单元，其获取与具有最小误差的定向梯度的直方图相关联地存储的平滑滤波器之一，并且通过所获取的平滑滤波器确定通过滤波处理处理的像素的校正像素值。