Method and device for stereo base extension of stereoscopic images and image sequences

    公开(公告)号:US09615075B2

    公开(公告)日:2017-04-04

    申请号:US13979557

    申请日:2012-01-17

    申请人: Rolf-Dieter Naske

    发明人: Rolf-Dieter Naske

    IPC分类号: H04N13/00 H04N13/02

    摘要: The invention relates to a method and a device for improving the depth impression of stereoscopic images and image sequences. In autostereoscopic multi-viewer display devices, generally a plurality of intermediate perspectives are generated, which lead to a reduced stereo base upon perception by the viewers. The stereo base widening presented in this application leads to a significant improvement and thus to a more realistic depth impression. It can either be effected during recording in the camera or be integrated into a display device. The improvement in the depth impression is achieved by the generation of synthetic perspectives situated, in the viewing direction of the camera lenses, on the left and right of the extreme left and extreme right recorded camera perspective on the right and left lengthening of the connection line formed by the extreme left and extreme right camera perspectives. These synthetic perspectives are calculated only on the basis of a disparity map, which is supplied or which is calculated in a preprocessing step. In this case, the method presented solves the following problems: 1. Calculation of the new extension perspectives, 2. Correct repositioning of the camera perspectives supplied within the visual zones, 3. Definition of which disparities are intended to be continued in the case of collision in the extension and 4. Interpolation of the image regions which become visible as a result of the extension of the stereo base. In this case, instances of left and right masking are also identified and optically correctly maintained and supplemented in the extension perspectives.

    METHOD AND DEVICE FOR STEREO BASE EXTENSION OF STEREOSCOPIC IMAGES AND IMAGE SEQUENCES
    2.
    发明申请
    METHOD AND DEVICE FOR STEREO BASE EXTENSION OF STEREOSCOPIC IMAGES AND IMAGE SEQUENCES 有权
    用于立体扩展立体图像和图像序列的方法和装置

    公开(公告)号:US20140347444A1

    公开(公告)日:2014-11-27

    申请号:US13979557

    申请日:2012-01-17

    申请人: Rolf-Dieter Naske

    发明人: Rolf-Dieter Naske

    IPC分类号: H04N13/00 H04N13/02

    摘要: The invention relates to a method and a device for improving the depth impression of stereoscopic images and image sequences. In autostereoscopic multi-viewer display devices, generally a plurality of intermediate perspectives are generated, which lead to a reduced stereo base upon perception by the viewers. The stereo base widening presented in this application leads to a significant improvement and thus to a more realistic depth impression. It can either be effected during recording in the camera or be integrated into a display device. The improvement in the depth impression is achieved by the generation of synthetic perspectives situated, in the viewing direction of the camera lenses, on the left and right of the extreme left and extreme right recorded camera perspective on the right and left lengthening of the connection line formed by the extreme left and extreme right camera perspectives. These synthetic perspectives are calculated only on the basis of a disparity map, which is supplied or which is calculated in a preprocessing step. In this case, the method presented solves the following problems: 1. Calculation of the new extension perspectives, 2. Correct repositioning of the camera perspectives supplied within the visual zones, 3. Definition of which disparities are intended to be continued in the case of collision in the extension and 4. Interpolation of the image regions which become visible as a result of the extension of the stereo base. In this case, instances of left and right masking are also identified and optically correctly maintained and supplemented in the extension perspectives.

    摘要翻译: 本发明涉及一种用于改善立体图像和图像序列的深度印象的方法和装置。 在自动立体多观察者显示装置中,通常产生多个中间视角,这导致观看者感知到的立体声降低。 在本应用中呈现的立体声基础拓宽导致了显着的改进,从而获得了更逼真的深度印象。 它可以在相机中录制过程中实现,也可以集成到显示设备中。 深度印象的改善是通过生成在相机透镜的观察方向上位于左,右右记录摄像机左侧和右侧的合成透视图,在右侧和右侧延长连接线 形成了极左和极右相机的视角。 这些合成透视图只是根据提供的视差图或在预处理步骤中计算的视差图来计算的。 在这种情况下,提出的方法解决了以下问题:1.计算新的扩展视角,2.正确重新定位视觉区域内提供的摄像机视角,3.定义在以下情况下将继续存在哪些差异 扩展中的碰撞和4.由于立体声基座的延伸而变得可见的图像区域的插值。 在这种情况下,还会识别左右掩蔽的实例,并在扩展视角中进行光学正确维护和补充。

    Method and device for the generation of 3-D images
    3.
    发明授权
    Method and device for the generation of 3-D images 有权
    用于生成3-D图像的方法和装置

    公开(公告)号:US07321374B2

    公开(公告)日:2008-01-22

    申请号:US10447463

    申请日:2003-05-29

    申请人: Rolf-Dieter Naske

    发明人: Rolf-Dieter Naske

    IPC分类号: G06T3/00 H04N15/00

    CPC分类号: H04N13/261

    摘要: A method for generating three-dimensional images based on a sequence of two-dimensional images is characterized by the steps of: analyzing a two-dimensional image with respect to its scene type, selecting a deformation assigned to the defined scene type with which the two-dimensional image is deformed, deforming the two-dimensional image and transmitting the deformed two-dimensional image to at least one viewing channel. The method also contemplates applying various transition functions to the two-dimensional image to provide a continuous and smooth transition from one scene type to another. The method can be carried out by an apparatus for performing these functions.

    摘要翻译: 基于二维图像序列生成三维图像的方法的特征在于以下步骤:分析与其场景类型相关的二维图像,选择分配给所定义的场景类型的变形, 维度图像变形,使二维图像变形并将变形的二维图像发送到至少一个观看通道。 该方法还考虑将各种过渡函数应用于二维图像以提供从一种场景类型到另一种场景类型的连续且平滑的过渡。 该方法可以通过用于执行这些功能的装置来执行。

    METHOD AND DEVICE FOR GENERATING 3D IMAGES
    6.
    发明申请
    METHOD AND DEVICE FOR GENERATING 3D IMAGES 审中-公开
    用于生成3D图像的方法和装置

    公开(公告)号:US20070269136A1

    公开(公告)日:2007-11-22

    申请号:US11835104

    申请日:2007-08-07

    申请人: Rolf-Dieter Naske

    发明人: Rolf-Dieter Naske

    IPC分类号: G06K9/36

    摘要: A method and a device for generating 3D images, according to which an image of a second sequence of images is generated in addition to an image of a first sequence of 2D images at an interval that can be determined via an approximation variable (α). A measure of similarity (dk) between successive images of the first sequence is determined and compared with threshold values (δ0

    摘要翻译: 一种用于产生3D图像的方法和装置,根据该方法和装置,除了可以经由近似变量(α)确定的间隔的2D图像的第一序列的图像之外,还生成第二图像序列的图像。 确定第一序列的连续图像之间的相似性度量(d k k k),并将其与阈值(delta> 1 < 以便根据其修改近似变量(α),使得立体基底宽度不会变得不自然。 相位分析器(12)用于确定第一图像序列的连续图像中的主要移动方向,并且使用相位转换器(16)将第一和第二图像序列的图像分配给左侧 或右手观看频道,这取决于第一序列的连续图像中的主要移动方向。

    Methods and systems for 2D/3D image conversion and optimization
    7.
    发明授权
    Methods and systems for 2D/3D image conversion and optimization 有权
    2D / 3D图像转换和优化的方法和系统

    公开(公告)号:US07254265B2

    公开(公告)日:2007-08-07

    申请号:US10338778

    申请日:2003-01-08

    IPC分类号: G06K9/00

    摘要: A method that improves compensation for hard cuts and/or vertical motion effects in the conversion of 2D images to 3D images, displays 2D images to one eye and computed images to the other eye. Generating the computed images includes using an approximation variable that represents some relationship between the 2D images, such as the speed of motion across two images. Compensating for the hard cut or vertical motion effect includes temporarily setting the approximation variable to a value that makes the left and right eye images more similar (if identical, displaying a 2D image). The approximation variable can be pre-set to a value based on the speed of motion in a scene to be displayed. A method of displaying images in either 2D or 3D may include converting 3D images to 2D images by displaying images computed from images intended for either the left eye or the right eye.

    摘要翻译: 将2D图像转换为3D图像时,可以提高对硬切割和/或垂直运动效果的补偿的方法,将2D图像显示给一只眼睛,并将另一只眼睛计算图像。 生成计算的图像包括使用表示2D图像之间的某些关系的近似变量,诸如跨两幅图像的运动速度。 补偿硬切割或垂直运动效果包括将近似变量临时设置为使得左眼图像和右眼图像更相似的值(如果相同,显示2D图像)。 近似变量可以根据要显示的场景中的运动速度预先设定为一个值。 以2D或3D显示图像的方法可以包括通过显示从用于左眼或右眼的图像计算出的图像来将3D图像转换成2D图像。

    METHODS AND SYSTEMS FOR 2D/3D IMAGE CONVERSION AND OPTIMIZATION
    9.
    发明申请
    METHODS AND SYSTEMS FOR 2D/3D IMAGE CONVERSION AND OPTIMIZATION 审中-公开
    2D / 3D图像转换和优化的方法和系统

    公开(公告)号:US20080085049A1

    公开(公告)日:2008-04-10

    申请号:US11835188

    申请日:2007-08-07

    IPC分类号: G06K9/00

    摘要: A method that improves compensation for hard cuts and/or vertical motion effects in the conversion of 2D images to 3D images, displays 2D images to one eye and computed images to the other eye. Generating the computed images includes using an approximation variable that represents some relationship between the 2D images, such as the speed of motion across two images. Compensating for the hard cut or vertical motion effect includes temporarily setting the approximation variable to a value that makes the left and right eye images more similar (if identical, displaying a 2D image). The approximation variable can be pre-set to a value based on the speed of motion in a scene to be displayed. A method of displaying images in either 2D or 3D may include converting 3D images to 2D images by displaying images computed from images intended for either the left eye or the right eye.

    摘要翻译: 将2D图像转换为3D图像时,可以提高对硬切割和/或垂直运动效果的补偿的方法,将2D图像显示给一只眼睛,并将另一只眼睛计算图像。 生成计算的图像包括使用表示2D图像之间的某些关系的近似变量,诸如跨两幅图像的运动速度。 补偿硬切割或垂直运动效果包括将近似变量临时设置为使得左眼图像和右眼图像更相似的值(如果相同,显示2D图像)。 近似变量可以根据要显示的场景中的运动速度预先设定为一个值。 以2D或3D显示图像的方法可以包括通过显示从用于左眼或右眼的图像计算出的图像来将3D图像转换成2D图像。

    Method and device for real-time multi-view production
    10.
    发明授权
    Method and device for real-time multi-view production 有权
    用于实时多视图制作的方法和装置

    公开(公告)号:US08736669B2

    公开(公告)日:2014-05-27

    申请号:US12810681

    申请日:2007-12-27

    申请人: Rolf-Dieter Naske

    发明人: Rolf-Dieter Naske

    IPC分类号: H04N13/02 H04N13/00 H04N13/04

    摘要: From a stereo image having at least 2 perspectives additional virtual perspectives are produced, wherein the processing time for the virtual perspectives is less than a specified value and simultaneously the multi-view image quality is maximized by identifying image areas that have not changed between two stereo images of the image sequence. In these areas the associated disparity map also did not change and the disparity values are reused. In addition, the processing parameters for calculating the virtual perspectives are continuously adjusted through continuous time measurement during processing such that the quality is always at a maximum. An adaptive method is obtained, which is also able to respond to load fluctuations of the underlying hardware device.

    摘要翻译: 从具有至少2个透视图的立体图像产生附加的虚拟视角,其中虚拟透视的处理时间小于指定值,并且同时通过识别在两个立体声之间没有改变的图像区域来最大化多视点图像质量 图像序列的图像。 在这些领域,相关的视差图也没有改变,差异值被重复使用。 此外,用于计算虚拟透视图的处理参数通过在处理期间的连续时间测量连续地调整,使得质量总是处于最大值。 获得了一种自适应方法,其也能够响应底层硬件设备的负载波动。