Method and apparatus for providing panoramic view with geometric correction
    42.
    发明申请
    Method and apparatus for providing panoramic view with geometric correction 有权
    用于提供具有几何校正的全景图的方法和装置

    公开(公告)号:US20070159527A1

    公开(公告)日:2007-07-12

    申请号:US11581401

    申请日:2006-10-17

    IPC分类号: H04N5/253

    摘要: A method and apparatus of correcting geometric information and providing a panoramic view. In the method of providing a panoramic view, a tilting vector (X′, Y′) is generated by applying matrices H(a,b) and HF to a source image vector (X,Y). The matrix H(a,b) is defined by distortion angles “b” towards a plane direction and a distortion angle “a” towards a depth direction of the source image, and the matrix HF is defined according to a camera parameter matrix K. Also, a two-dimensional vector (x,y) of a source image is converted into a three-dimensional vector (X,Y,W) on a retinal image plane having a unit radial distance from an origin of a ground plane. Also, a warped image width (WIW) is estimated from a width and a field of view (FOV) of the source image. A warping vector (x′,y′) is generated based on the converted vector (X,Y,W) and the WIW.

    摘要翻译: 一种校正几何信息并提供全景的方法和装置。 在提供全景图的方法中,通过将矩阵H(a,b)和HF应用于源图像矢量(X,Y)来产生倾斜矢量(X',Y')。 矩阵H(a,b)由朝向平面方向的畸变角“b”和朝向源图像的深度方向的畸变角“a”定义,矩阵HF根据照相机参数矩阵K来定义。 此外,源图像的二维向量(x,y)在具有距接地平面的原点的单位径向距离的视网膜图像平面上被转换为三维矢量(X,Y,W)。 此外,从源图像的宽度和视场(FOV)估计翘曲图像宽度(WIW)。 基于转换的矢量(X,Y,W)和WIW产生翘曲矢量(x',y')。

    Method and apparatus for providing panoramic view with high speed image matching and mild mixed color blending
    43.
    发明申请
    Method and apparatus for providing panoramic view with high speed image matching and mild mixed color blending 有权
    用于提供高速图像匹配和温和混合色彩混合的全景视图的方法和装置

    公开(公告)号:US20070159524A1

    公开(公告)日:2007-07-12

    申请号:US11591461

    申请日:2006-11-02

    IPC分类号: H04N7/00

    CPC分类号: G06T3/4038

    摘要: An apparatus and method of providing a panoramic image, the method including: preparing images of a plurality of levels, which are made by scaling each of two source images at several rates; computing a Sum of Square Difference (SSD) between two corresponding images in each of the plurality of levels of the two source images to form an image stitched together; and when stitching the two images, the overlapping area is divided into a plurality of parts and each part is assigned a weight which is linearly applied respectively to the divided part of each source image for blending color. The apparatus includes stitching units to stitch source images together at the plurality of levels and blending units to color blend the source images in the overlapped area.

    摘要翻译: 一种提供全景图像的装置和方法,所述方法包括:通过以几个比例缩放两个源图像中的每一个来制作多个级别的图像; 计算两个源图像的多个级别中的每一个中的两个对应图像之间的平方差(SSD)的和,以形成拼接在一起的图像; 并且当拼接两个图像时,重叠区域被分成多个部分,并且每个部分被分配一个分别线性地施加到每个源图像的分割部分以用于混合颜色的权重。 该装置包括缝合单元,以在多个级别上将源图像拼接在一起,并且混合单元将颜色混合在重叠区域中的源图像。

    Apparatus and method for bidirectionally inpainting occlusion area based on predicted volume
    46.
    发明授权
    Apparatus and method for bidirectionally inpainting occlusion area based on predicted volume 有权
    基于预测体积双向修复闭塞区域的装置和方法

    公开(公告)号:US09378583B2

    公开(公告)日:2016-06-28

    申请号:US13064785

    申请日:2011-04-14

    IPC分类号: G06T15/20 G06T7/00 G06T5/00

    摘要: An apparatus and method for bidirectionally inpainting an occlusion area appearing during generation of a virtual viewpoint image, using a foreground area and a background area based on a predicted volume are provided. The method includes receiving an input of a depth image and a color image, the depth image having depth information for a first viewpoint, and the color image having color information for the first viewpoint, generating a virtual viewpoint image at a second viewpoint based on the depth image and the color image, separating the virtual viewpoint image into a foreground area and a background area, based on the depth information and direction information regarding a direction from the first viewpoint to the second viewpoint, predicting a three-dimensional (3D) volume of the foreground area, and inpainting an occlusion area bidirectionally using the foreground area and the background area, based on the predicted 3D volume, the occlusion area being included in the virtual viewpoint image.

    摘要翻译: 提供了使用基于预测体积的前景区域和背景区域来双向地绘制在虚拟视点图像生成期间出现的遮挡区域的装置和方法。 该方法包括接收深度图像和彩色图像的输入,深度图像具有用于第一视点的深度信息,以及具有用于第一视点的颜色信息的彩色图像,基于第二视点生成虚拟视点图像 基于从第一视点到第二视点的方向的深度信息和方向信息,将虚拟视点图像分离成前景区域和背景区域,预测三维(3D)体积 并且基于所预测的3D体积,使用所述前景区域和所述背景区域双向地修复遮挡区域,所述遮挡区域包括在所述虚拟视点图像中。