公开(公告)号：US09280828B2

公开(公告)日：2016-03-08

申请号：US13482571

申请日：2012-05-29

申请人： Masami Ogata ,  Takafumi Morifuji ,  Suguru Ushiki

发明人： Masami Ogata ,  Takafumi Morifuji ,  Suguru Ushiki

IPC分类号： G06K9/00 ,  G06T7/00 ,  H04N13/00

CPC分类号： G06T7/0075 ,  G06T7/593 ,  G06T2207/10012 ,  H04N2013/0081

摘要： A parallax detection unit generates a parallax map indicating a parallax of each pixel of an image formed by right and left images and generates a reliability map indicating reliability of the parallax. A depth information estimation unit generates a depth information map indicating the depth of a subject on the image based on the right and left images. A depth parallax conversion unit converts the depth information map into a pseudo-parallax map using a conversion equation used to convert depth information to parallax information. A parallax synthesis unit synthesizes the parallax map and the pseudo-parallax map to generate a corrected parallax map based on the reliability map. The present technology is applicable to an image processing apparatus.

摘要翻译： 视差检测单元生成指示由左右图像形成的图像的每个像素的视差的视差图，并生成表示视差可靠性的可靠度图。 深度信息估计单元基于右图像和左图像生成指示对象在图像上的深度的深度信息映射。 深度视差转换单元使用用于将深度信息转换为视差信息的转换方程将深度信息图变换为伪视差图。 视差合成单元基于可靠性图，合成视差图和伪视差图，生成校正的视差图。 本技术适用于图像处理装置。

公开(公告)号：US08605994B2

公开(公告)日：2013-12-10

申请号：US13386166

申请日：2011-05-25

申请人： Masami Ogata ,  Takafumi Morifuji ,  Suguru Ushiki

发明人： Masami Ogata ,  Takafumi Morifuji ,  Suguru Ushiki

IPC分类号： G06K9/00

CPC分类号： G06T19/00 ,  H04N13/128 ,  H04N2013/0081

摘要： Disparity in a stereoscopic image is converted, according to features of a configuration element of an image that influences depth perception of a stereoscopic image. A disparity detecting unit 110 detects disparity from a left image L and right image R of an input image, and generates a disparity map dM. A disparity correction unit 150 corrects the disparity in the disparity map dM and generates a corrected disparity map dM′. A correction feature setting unit 130 sets the correction features in the event of performing disparity correction in the disparity correction unit 150. The image synthesizing unit 160 synthesizes the left image L and right image R of the stereoscopic image based on the corrected disparity map dM′ and outputs the stereoscopic image made up of a left image L′ and right image R′ as an output image. Thus, a stereoscopic image having disparity according to the set correction features is output. The correction features therein are set according to the degree that the configuration element features such as size of disparity, position on screen, manner of special change and so forth influence the depth perception.

摘要翻译： 根据影响立体图像的深度感知的图像的配置元件的特征，转换立体图像中的视差。 视差检测单元110从输入图像的左图像L和右图像R检测视差，并生成视差图dM。 视差校正单元150校正视差图dM中的视差，并产生校正的视差图dM'。 校正特征设置单元130在视差校正单元150中执行视差校正的情况下设置校正特征。图像合成单元160基于校正的视差图dM'来合成立体图像的左图像L和右图像R， 并输出由左图像L'和右图像R'构成的立体图像作为输出图像。 因此，输出根据设定的校正特征具有视差的立体图像。 其中的校正特征根据配置元件的特征如视差大小，屏幕上的位置，特殊变化的方式等的深度感知的程度来设定。

公开(公告)号：US20120308119A1

公开(公告)日：2012-12-06

申请号：US13482571

申请日：2012-05-29

申请人： Masami OGATA ,  Takafumi Morifuji ,  Suguru Ushiki

发明人： Masami OGATA ,  Takafumi Morifuji ,  Suguru Ushiki

IPC分类号： G06K9/00

CPC分类号： G06T7/0075 ,  G06T7/593 ,  G06T2207/10012 ,  H04N2013/0081

摘要： A parallax detection unit generates a parallax map indicating a parallax of each pixel of an image formed by right and left images and generates a reliability map indicating reliability of the parallax. A depth information estimation unit generates a depth information map indicating the depth of a subject on the image based on the right and left images. A depth parallax conversion unit converts the depth information map into a pseudo-parallax map using a conversion equation used to convert depth information to parallax information. A parallax synthesis unit synthesizes the parallax map and the pseudo-parallax map to generate a corrected parallax map based on the reliability map. The present technology is applicable to an image processing apparatus.

摘要翻译： 视差检测单元生成指示由左右图像形成的图像的每个像素的视差的视差图，并生成表示视差可靠性的可靠度图。 深度信息估计单元基于右图像和左图像生成指示对象在图像上的深度的深度信息映射。 深度视差转换单元使用用于将深度信息转换为视差信息的转换方程，将深度信息图变换为伪视差图。 视差合成单元基于可靠性图，合成视差图和伪视差图，生成校正的视差图。 本技术适用于图像处理装置。

公开(公告)号：US09247230B2

公开(公告)日：2016-01-26

申请号：US13272870

申请日：2011-10-13

申请人： Masami Ogata ,  Takafumi Morifuji ,  Suguru Ushiki

发明人： Masami Ogata ,  Takafumi Morifuji ,  Suguru Ushiki

IPC分类号： H04N13/00

CPC分类号： H04N13/128 ,  H04N2013/0074 ,  H04N2013/0081

摘要： An image processing apparatus includes a first display control unit that causes a display unit to display a first 3D image, a receiving unit that receives, from a user, a message indicating whether an amount of parallax of the first 3D image being displayed on the display unit is within an allowable range, a determining unit that determines an estimated allowable range on the basis of the message received by the receiving unit so that if the message indicates that the amount of parallax of the 3D image being displayed is not within the allowable range, the amount of parallax is not included in the estimated allowable range; and a second display control unit that causes the display unit to display a second 3D image on the basis of the estimated allowable range.

摘要翻译： 图像处理装置包括使显示单元显示第一3D图像的第一显示控制单元，从用户接收指示显示在显示器上的第一3D图像的视差量的消息的接收单元 单元在允许范围内，确定单元，其基于由接收单元接收的消息来确定估计的允许范围，使得如果该消息指示正在显示的3D图像的视差量不在允许范围内 视差量不包括在估计容许范围内; 以及第二显示控制单元，其使得所述显示单元基于所估计的允许范围来显示第二3D图像。

公开(公告)号：US20130038703A1

公开(公告)日：2013-02-14

申请号：US13635030

申请日：2011-04-06

申请人： Suguru Ushiki ,  Masami Ogata ,  Takafumi Morifuji

发明人： Suguru Ushiki ,  Masami Ogata ,  Takafumi Morifuji

IPC分类号： H04N13/04 ,  H04N13/00

CPC分类号： H04N21/4884 ,  H04N13/128 ,  H04N13/139 ,  H04N13/172 ,  H04N13/178 ,  H04N13/183 ,  H04N13/189 ,  H04N21/4516

摘要： The present invention relates to data structures, image processing apparatuses, image processing methods, and programs for enabling appropriate processing of video data of 3D content.Obtained content data of 3D content contains video data of 3D images, and information about a reference image size, which is a predetermined image size serving as the reference for the 3D images, and the maximum and minimum parallaxes for the reference image size. An image size detecting unit (71) detects the image size of the video data of the 3D images. If the detected image size of the 3D video data is not the same as the “reference image size,” a maximum/minimum parallax calculating unit (72) calculates the maximum and minimum parallaxes corresponding to the image size of the 3D video data. A caption adjusting unit (73) performs predetermined image processing based on the calculated maximum and minimum parallaxes, such as processing to adjust the depth positions of captions. The present invention can be applied to an image processing apparatus that processes obtained image data of 3D images, for example.

摘要翻译： 本发明涉及数据结构，图像处理装置，图像处理方法以及用于实现3D内容的视频数据的适当处理的程序。 获得的3D内容的内容数据包含3D图像的视频数据，以及作为用于3D图像的基准的预定图像大小的参考图像尺寸以及参考图像尺寸的最大和最小视差的信息。 图像尺寸检测单元（71）检测3D图像的视频数据的图像尺寸。 如果检测到的3D视频数据的图像尺寸与参考图像尺寸不相同，则最大/最小视差计算单元（72）计算与3D视频数据的图像尺寸相对应的最大和最小视差。 字幕调整单元（73）基于所计算出的最大和最小视差进行预定的图像处理，例如用于调整字幕的深度位置的处理。 本发明可以应用于例如处理所获得的3D图像的图像数据的图像处理装置。

公开(公告)号：US08989482B2

公开(公告)日：2015-03-24

申请号：US13486763

申请日：2012-06-01

申请人： Takafumi Morifuji ,  Kyoko Fukuda ,  Masami Ogata ,  Suguru Ushiki

发明人： Takafumi Morifuji ,  Kyoko Fukuda ,  Masami Ogata ,  Suguru Ushiki

IPC分类号： G06K9/00 ,  G06T5/00 ,  H04N13/00

CPC分类号： G06T5/002 ,  G06T2207/10028 ,  H04N13/128 ,  H04N13/144

摘要： An image processing apparatus includes an attention region estimation unit that estimates an attention region which is estimated as a user paying attention thereto on a stereoscopic image, a parallax detection unit that detects a parallax of the stereoscopic image and generates a parallax map indicating a parallax of each region of the stereoscopic image, a setting unit that sets conversion characteristics for correcting a parallax of the stereoscopic image based on the attention region and the parallax map, and a parallax conversion unit that corrects the parallax map based on the conversion characteristics.

摘要翻译： 一种图像处理装置包括：注意区域估计单元，其估计作为对立体图像关注的用户的关注区域;视差检测单元，其检测立体图像的视差并生成指示视差的视差映射 立体图像的每个区域，设置单元，其基于注意区域和视差映射设置用于校正立体图像的视差的转换特性;以及视差转换单元，其基于转换特性来校正视差图。

公开(公告)号：US20120176371A1

公开(公告)日：2012-07-12

申请号：US13126966

申请日：2010-08-19

申请人： Takafumi Morifuji ,  Suguru Ushiki ,  Masami Ogata

发明人： Takafumi Morifuji ,  Suguru Ushiki ,  Masami Ogata

IPC分类号： G06K9/36 ,  G06T15/00

CPC分类号： H04N13/128 ,  G02B27/2214 ,  G06T7/97 ,  H04N13/122 ,  H04N2013/0081

摘要： To reduce burden of a viewer at the time of performing stereoscopic display by a stereoscopic display device and to show a stereoscopic image in a natural and comfortable manner.A disparity estimating unit 210 estimates disparity from the left and right images of an input image to generate a disparity map. A disparity analyzing unit 230 analyzes the disparity map to generate a disparity control parameter for performing suitable disparity control. A disparity control unit 240 controls the content of processing at an image conversion unit 250 in accordance with the disparity control parameter. The image conversion unit 250 performs image conversion on the input image based on the control by the disparity control unit 240 to output an output image. The image conversion unit 250 performs image conversion of two steps. The image conversion unit 250 performs shift processing for shifting the relative positions of the left and right images of the input image in the horizontal direction as first step image conversion, for example. The image conversion unit 250 performs scaling processing for performing enlargement/reduction of the entire screen with each center of the left and right images as a reference, as second step image conversion, for example.

摘要翻译： 为了减轻立体显示装置的立体显示时的观看者的负担，以自然舒适的方式显示立体图像。 视差估计单元210从输入图像的左图像和右图像估计视差以生成视差图。 视差分析单元230分析视差图以生成用于执行适当视差控制的视差控制参数。 视差控制单元240根据视差控制参数控制图像转换单元250处理的内容。 图像转换单元250基于视差控制单元240的控制输出输出图像，对输入图像进行图像转换。 图像转换单元250执行两个步骤的图像转换。 图像转换单元250例如执行用于将输入图像的左右图像在水平方向上的相对位置偏移的移位处理作为第一步骤图像转换。 图像转换单元250执行缩放处理，用于以左右图像的每个中心为基准进行整个屏幕的放大/缩小，例如作为第二步图像转换。

公开(公告)号：US09219911B2

公开(公告)日：2015-12-22

申请号：US13082397

申请日：2011-04-07

申请人： Suguru Ushiki ,  Takafumi Morifuji ,  Masami Ogata

发明人： Suguru Ushiki ,  Takafumi Morifuji ,  Masami Ogata

IPC分类号： H04N13/02 ,  H04N13/04 ,  H04N13/00 ,  H04N21/431 ,  H04N21/4402 ,  H04N21/45 ,  H04N21/81 ,  H04N21/84

CPC分类号： H04N13/398 ,  H04N13/128 ,  H04N13/139 ,  H04N21/431 ,  H04N21/440263 ,  H04N21/4516 ,  H04N21/816 ,  H04N21/84

摘要： An image processing apparatus includes a first acquiring unit, a second acquiring unit, and a correction processor. The first acquiring unit acquires an intended viewing environment parameter, which is a parameter of an intended viewing environment, together with image data of a three-dimensional picture. The second acquiring unit acquires an actual viewing environment parameter, which is a parameter of an actual viewing environment for a user viewing the three-dimensional picture. The correction processor corrects the three-dimensional picture in accordance with a difference between the acquired intended viewing environment parameter and the acquired actual viewing environment parameter.

摘要翻译： 图像处理装置包括第一获取单元，第二获取单元和校正处理器。 第一获取单元与三维图像的图像数据一起获取作为预期观看环境的参数的预期观看环境参数。 第二获取单元获取作为观看三维图像的用户的实际观看环境的参数的实际观看环境参数。 校正处理器根据所获取的预期观看环境参数与所获取的实际观看环境参数之间的差异来校正三维图片。

公开(公告)号：US20120148147A1

公开(公告)日：2012-06-14

申请号：US13386166

申请日：2011-05-25

申请人： Masami Ogata ,  Takafumi Morifuji ,  Suguru Ushiki

发明人： Masami Ogata ,  Takafumi Morifuji ,  Suguru Ushiki

IPC分类号： G06K9/00

CPC分类号： G06T19/00 ,  H04N13/128 ,  H04N2013/0081

摘要： Disparity in a stereoscopic image is converted, according to features of a configuration element of an image that influences depth perception of a stereoscopic image. A disparity detecting unit 110 detects disparity from a left image L and right image R of an input image, and generates a disparity map dM. A disparity correction unit 150 corrects the disparity in the disparity map dM and generates a corrected disparity map dM′. A correction feature setting unit 130 sets the correction features in the event of performing disparity correction in the disparity correction unit 150. The image synthesizing unit 160 synthesizes the left image L and right image R of the stereoscopic image based on the corrected disparity map dM′ and outputs the stereoscopic image made up of a left image L′ and right image R′ as an output image. Thus, a stereoscopic image having disparity according to the set correction features is output. The correction features therein are set according to the degree that the configuration element features such as size of disparity, position on screen, manner of special change and so forth influence the depth perception.

摘要翻译： 根据影响立体图像的深度感知的图像的配置元件的特征，转换立体图像中的视差。 视差检测单元110从输入图像的左图像L和右图像R检测视差，并生成视差图dM。 视差校正单元150校正视差图dM中的视差，并产生校正的视差图dM'。 校正特征设置单元130在视差校正单元150中执行视差校正的情况下设置校正特征。图像合成单元160基于校正的视差图dM'来合成立体图像的左图像L和右图像R， 并输出由左图像L'和右图像R'构成的立体图像作为输出图像。 因此，输出根据设定的校正特征具有视差的立体图像。 其中的校正特征根据配置元件的特征如视差大小，屏幕上的位置，特殊变化的方式等的深度感知的程度来设定。

公开(公告)号：US20120098828A1

公开(公告)日：2012-04-26

申请号：US13272870

申请日：2011-10-13

申请人： Masami Ogata ,  Takafumi Morifuji ,  Suguru Ushiki

发明人： Masami Ogata ,  Takafumi Morifuji ,  Suguru Ushiki

IPC分类号： G06T15/00

CPC分类号： H04N13/128 ,  H04N2013/0074 ,  H04N2013/0081

摘要： An image processing apparatus includes a first display control unit that causes a display unit to display a first 3D image, a receiving unit that receives, from a user, a message indicating whether an amount of parallax of the first 3D image being displayed on the display unit is within an allowable range, a determining unit that determines an estimated allowable range on the basis of the message received by the receiving unit so that if the message indicates that the amount of parallax of the 3D image being displayed is not within the allowable range, the amount of parallax is not included in the estimated allowable range; and a second display control unit that causes the display unit to display a second 3D image on the basis of the estimated allowable range.

摘要翻译： 图像处理装置包括使显示单元显示第一3D图像的第一显示控制单元，从用户接收指示显示在显示器上的第一3D图像的视差量的消息的接收单元 单元在允许范围内，确定单元，其基于由接收单元接收的消息来确定估计的可允许范围，使得如果消息指示正在显示的3D图像的视差量不在允许范围内 视差量不包括在估计容许范围内; 以及第二显示控制单元，其使得所述显示单元基于所估计的允许范围来显示第二3D图像。