公开(公告)号：US08682060B2

公开(公告)日：2014-03-25

申请号：US13049620

申请日：2011-03-16

申请人： Nao Mishima ,  Takeshi Mita

发明人： Nao Mishima ,  Takeshi Mita

IPC分类号： G06K9/00 ,  G06K9/62 ,  G01C3/14 ,  G02B27/22

CPC分类号： G06T7/254

摘要： According to one embodiment, an image processing method includes calculating an activity value for a first block, the activity value indicating a higher degree of activity as pixel values vary in a greater degree in the first block, and calculating a first evaluation value that indicates higher evaluation as a difference between a pixel value of the first block and a pixel value of a second block is smaller. The method further includes calculating a second evaluation value that indicates higher evaluation as correlation between a relative spatial relationship of the pixel value of the first block and that of the pixel value of the second block is higher, and calculating a third evaluation value by weighting the first evaluation value and the second evaluation value to search for the second block that corresponds to the first block, a weight of the first evaluation value is larger as the activity value is larger.

摘要翻译： 根据一个实施例，一种图像处理方法包括：计算第一块的活动值，所述活动值指示在第一块中像素值在较大程度上变化的较高活动度，并且计算指示较高的第一评估值 作为第一块的像素值和第二块的像素值之间的差的评估较小。 该方法还包括计算表示较高评估的第二评估值，作为第一块的像素值与第二块的像素值的相对空间关系之间的相关性较高，并且通过对第 第一评估值和第二评估值，以搜索对应于第一块的第二块，则第一评估值的权重随着活动值较大而较大。

公开(公告)号：US08665319B2

公开(公告)日：2014-03-04

申请号：US12888582

申请日：2010-09-23

申请人： Nao Mishima ,  Takeshi Mita ,  Kenichi Shimoyama ,  Ryusuke Hirai ,  Masahiro Baba

发明人： Nao Mishima ,  Takeshi Mita ,  Kenichi Shimoyama ,  Ryusuke Hirai ,  Masahiro Baba

IPC分类号： H04N13/02

CPC分类号： G06T5/002 ,  G06T2207/10012 ,  G06T2207/10028 ,  H04N13/128 ,  H04N13/275

摘要： According to one embodiment, a parallax image generating apparatus is for generating, using a first image, a parallax images with a parallax therebetween. The apparatus includes following units. The first estimation unit estimates distribution information items indicating distributions of first depths in the first image by using first methods. The distribution information items falls within a depth range to be reproduced. The first combination unit combines the distribution information items to generate first depth information. The second calculation unit calculates second depth information indicating relative unevenness of an object in the first image. The third combination unit combines the first depth information and the second depth information by using a method different from the first methods, to generate third depth information. The generation unit generates the parallax images based on the third depth information and the first image.

摘要翻译： 根据一个实施例，视差图像生成装置用于使用第一图像生成其间具有视差的视差图像。 该装置包括以下单元。 第一估计单元通过使用第一方法估计指示第一图像中的第一深度的分布的分布信息项。 分发信息项落在要再现的深度范围内。 第一组合单元组合分配信息项以产生第一深度信息。 第二计算单元计算指示第一图像中的物体的相对不均匀性的第二深度信息。 第三组合单元通过使用与第一方法不同的方法组合第一深度信息和第二深度信息，以产生第三深度信息。 生成单元基于第三深度信息和第一图像生成视差图像。

公开(公告)号：US20130258057A1

公开(公告)日：2013-10-03

申请号：US13666194

申请日：2012-11-01

申请人： Nao MISHIMA ,  Takeshi Mita

发明人： Nao MISHIMA ,  Takeshi Mita

IPC分类号： H04N13/02

CPC分类号： G02B27/2214 ,  H04N13/305 ,  H04N13/317 ,  H04N13/349

摘要： According to an image processing device includes an acquiring unit and a correcting unit. The acquiring unit is configured to acquire a stereoscopic image containing a plurality of parallax images each having a mutually different parallax. The correcting unit is configured to perform, for each pixel of the stereoscopic image, correction to set a parallax number of a parallax image viewed at a viewpoint position to a first parallax number of a parallax image to be viewed at the viewpoint position by using correction data representing a difference value between the first parallax number and a second parallax number of a parallax image that is actually viewed at the viewpoint position and on which distortion correction for correcting distortion of light beams has been performed.

摘要翻译： 根据图像处理装置包括获取单元和校正单元。 获取单元被配置为获取包含具有彼此不同的视差的多个视差图像的立体图像。 校正单元被配置为对于立体图像的每个像素执行校正，以通过使用校正将在视点位置处观看的视差图像的视差编号设置为在视点位置观看的视差图像的第一视差编号 表示在视点位置上实际观看的视差图像的第一视差数和第二视差编号之间的差值的数据，并且进行用于校正光束失真的失真校正。

公开(公告)号：US20120169844A1

公开(公告)日：2012-07-05

申请号：US13415381

申请日：2012-03-08

申请人： Nao MISHIMA ,  Kenichi Shimoyama ,  Takeshi Mita ,  Takashi Ida

发明人： Nao MISHIMA ,  Kenichi Shimoyama ,  Takeshi Mita ,  Takashi Ida

IPC分类号： H04N13/04

CPC分类号： G06T7/97 ,  H04N13/221

摘要： An image processing method for creating a disparity image for 3D display from a 2D video image includes detecting based on a first image of the 2D video image in a time and a second image in a time different from the first image, motion vectors between the first and second images for each block of the first image, detecting from the motion vectors, a most backward vector of a portion whose depth is on the back side, calculating differential vectors between each motion vector and the most backward vector and giving a depth on a close to the block of the first image corresponding to the motion vector having the larger differential vector and creating one or more disparity images from the first image and the depth.

摘要翻译： 一种用于从2D视频图像创建用于3D显示的视差图像的图像处理方法包括：在与第一图像不同的时间内基于2D视频图像的第一图像和第二图像的检测，第一图像与第一图像之间的运动矢量 以及第一图像的每个块的第二图像，从运动矢量检测深度在背面的部分的最后向量，计算每个运动矢量与最后向矢量之间的差分向量，并且在 靠近与具有较大差分矢量的运动矢量对应的第一图像的块，并且从第一图像和深度创建一个或多个视差图像。

公开(公告)号：US09110296B2

公开(公告)日：2015-08-18

申请号：US13666194

申请日：2012-11-01

申请人： Nao Mishima ,  Takeshi Mita

发明人： Nao Mishima ,  Takeshi Mita

IPC分类号： H04N13/02 ,  G02B27/22 ,  H04N13/04

CPC分类号： G02B27/2214 ,  H04N13/305 ,  H04N13/317 ,  H04N13/349

摘要： According to an image processing device includes an acquiring unit and a correcting unit. The acquiring unit is configured to acquire a stereoscopic image containing a plurality of parallax images each having a mutually different parallax. The correcting unit is configured to perform, for each pixel of the stereoscopic image, correction to set a parallax number of a parallax image viewed at a viewpoint position to a first parallax number of a parallax image to be viewed at the viewpoint position by using correction data representing a difference value between the first parallax number and a second parallax number of a parallax image that is actually viewed at the viewpoint position and on which distortion correction for correcting distortion of light beams has been performed.

摘要翻译： 根据图像处理装置包括获取单元和校正单元。 获取单元被配置为获取包含具有彼此不同的视差的多个视差图像的立体图像。 校正单元被配置为对于立体图像的每个像素执行校正，以通过使用校正将在视点位置处观看的视差图像的视差编号设置为在视点位置观看的视差图像的第一视差编号 表示在视点位置上实际观看的视差图像的第一视差数和第二视差编号之间的差值的数据，并且进行用于校正光束失真的失真校正。

公开(公告)号：US20110242280A1

公开(公告)日：2011-10-06

申请号：US12888582

申请日：2010-09-23

申请人： Nao Mishima ,  Takeshi Mita ,  Kenichi Shimoyama ,  Ryusuke Hirai ,  Masahiro Baba

发明人： Nao Mishima ,  Takeshi Mita ,  Kenichi Shimoyama ,  Ryusuke Hirai ,  Masahiro Baba

IPC分类号： H04N13/02

CPC分类号： G06T5/002 ,  G06T2207/10012 ,  G06T2207/10028 ,  H04N13/128 ,  H04N13/275

摘要： According to one embodiment, a parallax image generating apparatus is for generating, using a first image, a parallax images with a parallax therebetween. The apparatus includes following units. The first estimation unit estimates distribution information items indicating distributions of first depths in the first image by using first methods. The distribution information items falls within a depth range to be reproduced. The first combination unit combines the distribution information items to generate first depth information. The second calculation unit calculates second depth information indicating relative unevenness of an object in the first image. The third combination unit combines the first depth information and the second depth information by using a method different from the first methods, to generate third depth information. The generation unit generates the parallax images based on the third depth information and the first image.

摘要翻译： 根据一个实施例，视差图像生成装置用于使用第一图像生成其间具有视差的视差图像。 该装置包括以下单元。 第一估计单元通过使用第一方法估计指示第一图像中的第一深度的分布的分布信息项。 分发信息项落在要再现的深度范围内。 第一组合单元组合分配信息项以产生第一深度信息。 第二计算单元计算指示第一图像中的物体的相对不均匀性的第二深度信息。 第三组合单元通过使用与第一方法不同的方法组合第一深度信息和第二深度信息，以产生第三深度信息。 生成单元基于第三深度信息和第一图像生成视差图像。

公开(公告)号：US08427488B2

公开(公告)日：2013-04-23

申请号：US13409213

申请日：2012-03-01

申请人： Ryusuke Hirai ,  Hidenori Takeshima ,  Takeshi Mita ,  Nao Mishima ,  Kenichi Shimoyama ,  Takashi Ida

发明人： Ryusuke Hirai ,  Hidenori Takeshima ,  Takeshi Mita ,  Nao Mishima ,  Kenichi Shimoyama ,  Takashi Ida

IPC分类号： G06T1/20 ,  G06K9/54 ,  G06K9/60

CPC分类号： G06T3/4007 ,  H04N13/106 ,  H04N13/128 ,  H04N13/261 ,  H04N2013/0081

摘要： According to one embodiment, a parallax image generating apparatus includes a deriving unit, a generating unit, a first calculating unit, a setting unit, a searching unit, and an interpolating unit. The deriving unit derives a parallax vector corresponding to a first pixel from the input image and depth information associated with the first pixel. The generating unit generates an intermediate image. The first calculating unit calculates first weights for respective pixels of a parallax image. The setting unit sets one or more candidate blocks near a shade-forming-area pixel of the intermediate image, and sets a reference block among one or more candidate blocks. The searching unit searches a target block similar to the reference block in the input image and/or the intermediate image. The interpolating unit interpolates a pixel value of the shade-forming-area pixel.

摘要翻译： 根据一个实施例，视差图像生成装置包括导出单元，生成单元，第一计算单元，设置单元，搜索单元和内插单元。 导出单元从输入图像中导出对应于第一像素的视差矢量和与第一像素相关联的深度信息。 生成单元生成中间图像。 第一计算单元计算视差图像的各个像素的第一权重。 设置单元在中间图像的阴影形成区域像素附近设置一个或多个候选块，并且在一个或多个候选块中设置参考块。 搜索单元在输入图像和/或中间图像中搜索与参考块类似的目标块。 内插单元内插色调形成区域像素的像素值。

公开(公告)号：US20130050303A1

公开(公告)日：2013-02-28

申请号：US13415175

申请日：2012-03-08

申请人： Nao MISHIMA ,  Kenichi Shimoyama ,  Takeshi Mita

发明人： Nao MISHIMA ,  Kenichi Shimoyama ,  Takeshi Mita

IPC分类号： G09G5/10

CPC分类号： G02B27/2214 ,  G02B27/225 ,  H04N13/305 ,  H04N13/31 ,  H04N13/317 ,  H04N13/351 ,  H04N13/376 ,  H04N13/383 ,  H04N13/398

摘要： According to an embodiment, an image processing device includes a specifying unit configured to specify, from among a plurality of parallax images each having a mutually different parallax, a pixel area containing at least a single pixel; and a modifying unit configured to, depending on a positional relationship between each pixel in the pixel area specified from among the parallax images and a viewpoint position of a viewer, modify the pixel area into a modified pixel area that contains a pixel which is supposed to be viewed from the viewpoint position.

摘要翻译： 根据实施例，图像处理装置包括：指定单元，被配置为从具有互不相同的视差的多个视差图像中指定包含至少单个像素的像素区域; 以及修改单元，被配置为根据从视差图像指定的像素区域中的每个像素与观看者的视点位置之间的位置关系来修改像素区域到修改像素区域，该修改像素区域包含应该 从视点位置观察。

公开(公告)号：US20120162200A1

公开(公告)日：2012-06-28

申请号：US13227210

申请日：2011-09-07

申请人： Nao MISHIMA ,  Takeshi Mita ,  Masahiro Baba

发明人： Nao MISHIMA ,  Takeshi Mita ,  Masahiro Baba

IPC分类号： G06T15/00

CPC分类号： H04N13/128

摘要： According to an embodiment, a map converting method includes calculating existing frequency of depths in a first map, the first map corresponding to at least an image area of an image and each pixel of the first map representing a depth corresponding to a pixel of the image area; and first converting the first map into a second map that represents a depth in a first range for each pixel by using the existing frequency.

摘要翻译： 根据实施例，地图转换方法包括计算第一地图中的深度的现有频率，第一地图对应于图像的至少一个图像区域，第一地图的每个像素表示与图像的像素对应的深度 区; 并且首先通过使用现有频率将第一映射转换成表示每个像素的第一范围内的深度的第二映射。

公开(公告)号：US20120128256A1

公开(公告)日：2012-05-24

申请号：US13049620

申请日：2011-03-16

申请人： Nao Mishima ,  Takeshi Mita

发明人： Nao Mishima ,  Takeshi Mita

IPC分类号： G06K9/62

CPC分类号： G06T7/254

摘要： According to one embodiment, an image processing method includes calculating an activity value for a first block, the activity value indicating a higher degree of activity as pixel values vary in a greater degree in the first block, and calculating a first evaluation value that indicates higher evaluation as a difference between a pixel value of the first block and a pixel value of a second block is smaller. The method further includes calculating a second evaluation value that indicates higher evaluation as correlation between a relative spatial relationship of the pixel value of the first block and that of the pixel value of the second block is higher, and calculating a third evaluation value by weighting the first evaluation value and the second evaluation value to search for the second block that corresponds to the first block, a weight of the first evaluation value is larger as the activity value is larger.

摘要翻译： 根据一个实施例，一种图像处理方法包括：计算第一块的活动值，所述活动值指示在第一块中像素值在较大程度上变化的较高活动度，并且计算指示较高的第一评估值 作为第一块的像素值和第二块的像素值之间的差的评估较小。 该方法还包括计算表示较高评估的第二评估值，作为第一块的像素值与第二块的像素值的相对空间关系之间的相关性较高，并且通过对第 第一评估值和第二评估值，以搜索对应于第一块的第二块，则第一评估值的权重随着活动值较大而较大。