Apparatus and method for bidirectionally inpainting occlusion area based on predicted volume
    1.
    发明授权
    Apparatus and method for bidirectionally inpainting occlusion area based on predicted volume 有权
    基于预测体积双向修复闭塞区域的装置和方法

    公开(公告)号:US09378583B2

    公开(公告)日:2016-06-28

    申请号:US13064785

    申请日:2011-04-14

    IPC分类号: G06T15/20 G06T7/00 G06T5/00

    摘要: An apparatus and method for bidirectionally inpainting an occlusion area appearing during generation of a virtual viewpoint image, using a foreground area and a background area based on a predicted volume are provided. The method includes receiving an input of a depth image and a color image, the depth image having depth information for a first viewpoint, and the color image having color information for the first viewpoint, generating a virtual viewpoint image at a second viewpoint based on the depth image and the color image, separating the virtual viewpoint image into a foreground area and a background area, based on the depth information and direction information regarding a direction from the first viewpoint to the second viewpoint, predicting a three-dimensional (3D) volume of the foreground area, and inpainting an occlusion area bidirectionally using the foreground area and the background area, based on the predicted 3D volume, the occlusion area being included in the virtual viewpoint image.

    摘要翻译: 提供了使用基于预测体积的前景区域和背景区域来双向地绘制在虚拟视点图像生成期间出现的遮挡区域的装置和方法。 该方法包括接收深度图像和彩色图像的输入,深度图像具有用于第一视点的深度信息,以及具有用于第一视点的颜色信息的彩色图像,基于第二视点生成虚拟视点图像 基于从第一视点到第二视点的方向的深度信息和方向信息,将虚拟视点图像分离成前景区域和背景区域,预测三维(3D)体积 并且基于所预测的3D体积,使用所述前景区域和所述背景区域双向地修复遮挡区域,所述遮挡区域包括在所述虚拟视点图像中。

    Method and apparatus for temporally interpolating three-dimensional depth image
    2.
    发明授权
    Method and apparatus for temporally interpolating three-dimensional depth image 有权
    时间插值三维深度图像的方法和装置

    公开(公告)号:US09210398B2

    公开(公告)日:2015-12-08

    申请号:US13088685

    申请日:2011-04-18

    摘要: A method and apparatus for temporally interpolating a three-dimensional (3D) depth image are provided to generate an intermediate depth image in a desired time. The apparatus may interpolate depth images generated by a depth camera, using a temporal interpolation procedure, may generate an intermediate depth image in a new time using the interpolated depth images, and may combine the generated intermediate depth image with color images, to generate a high-precision 3D image.

    摘要翻译: 提供了用于时间内插三维(3D)深度图像的方法和装置,以在期望的时间内生成中间深度图像。 该装置可以使用时间插值程序对由深度相机生成的深度图像进行内插,可以使用内插的深度图像在新的时间内生成中间深度图像,并且可以将生成的中间深度图像与彩色图像组合以产生高 精确3D图像。

    Apparatus and method for bidirectionally inpainting occlusion area based on predicted volume
    3.
    发明申请
    Apparatus and method for bidirectionally inpainting occlusion area based on predicted volume 有权
    基于预测体积双向修复闭塞区域的装置和方法

    公开(公告)号:US20120001902A1

    公开(公告)日:2012-01-05

    申请号:US13064785

    申请日:2011-04-14

    IPC分类号: G06T15/00

    摘要: An apparatus and method for bidirectionally inpainting an occlusion area appearing during generation of a virtual viewpoint image, using a foreground area and a background area based on a predicted volume are provided. The method includes receiving an input of a depth image and a color image, the depth image having depth information for a first viewpoint, and the color image having color information for the first viewpoint, generating a virtual viewpoint image at a second viewpoint based on the depth image and the color image, separating the virtual viewpoint image into a foreground area and a background area, based on the depth information and direction information regarding a direction from the first viewpoint to the second viewpoint, predicting a three-dimensional (3D) volume of the foreground area, and inpainting an occlusion area bidirectionally using the foreground area and the background area, based on the predicted 3D volume, the occlusion area being included in the virtual viewpoint image.

    摘要翻译: 提供了使用基于预测体积的前景区域和背景区域来双向地绘制在虚拟视点图像生成期间出现的遮挡区域的装置和方法。 该方法包括接收深度图像和彩色图像的输入,深度图像具有用于第一视点的深度信息,以及具有用于第一视点的颜色信息的彩色图像,基于第二视点生成虚拟视点图像 基于从第一视点到第二视点的方向的深度信息和方向信息,将虚拟视点图像分离成前景区域和背景区域,预测三维(3D)体积 并且基于所预测的3D体积,使用所述前景区域和所述背景区域双向地修复遮挡区域,所述遮挡区域包括在所述虚拟视点图像中。

    Apparatus and method for generating skeleton model using motion data and image data
    7.
    发明授权
    Apparatus and method for generating skeleton model using motion data and image data 有权
    使用运动数据和图像数据生成骨架模型的装置和方法

    公开(公告)号:US08766977B2

    公开(公告)日:2014-07-01

    申请号:US12539170

    申请日:2009-08-11

    IPC分类号: G06T17/00 G06K9/00 G06K9/44

    摘要: An apparatus and method for generating a skeleton model using motion data and image data. The apparatus for generating the skeleton model may synchronize the image data and the motion data, and generate a three-dimensional (3D) skeleton model of an entire body of a user using a silhouette extracted from the image data and also using a position or orientation of a joint of the user extracted from the motion data. The skeleton model may be generated using the image data and the motion data, thereby improving accuracy of the skeleton model of the entire body of the user.

    摘要翻译: 一种使用运动数据和图像数据生成骨架模型的装置和方法。 用于生成骨架模型的装置可以使图像数据和运动数据同步,并且使用从图像数据提取的轮廓并且还使用位置或取向来生成用户的整个身体的三维(3D)骨架模型 的用户从运动数据中提取的关节。 可以使用图像数据和运动数据来生成骨架模型,从而提高用户的整个身体的骨架模型的精度。

    IMAGE PROCESSING APPARATUS AND METHOD
    9.
    发明申请
    IMAGE PROCESSING APPARATUS AND METHOD 审中-公开
    图像处理装置和方法

    公开(公告)号:US20130266208A1

    公开(公告)日:2013-10-10

    申请号:US13816433

    申请日:2011-08-10

    IPC分类号: G06T7/00

    摘要: Provided is an image processing apparatus. A boundary detector of the image processing apparatus may detect a boundary of an occlusion region of a color image warped in correspondence to a first view. A boundary labeling unit of the image processing apparatus may label the detected boundary with one of a foreground region boundary and a background region boundary.

    摘要翻译: 提供了一种图像处理装置。 图像处理装置的边界检测器可以检测与第一视图相对应的翘曲的彩色图像的遮挡区域的边界。 图像处理装置的边界标记单元可以用前景区域边界和背景区域边界中的一个标记检测到的边界。

    Image processing apparatus and method
    10.
    发明授权
    Image processing apparatus and method 有权
    图像处理装置及方法

    公开(公告)号:US09369696B2

    公开(公告)日:2016-06-14

    申请号:US13030550

    申请日:2011-02-18

    IPC分类号: H04N13/02 G06T7/00

    摘要: A first calculator of an image processing apparatus may trace a view transform vector between color images of different frames. A second calculator may trace a view transform vector between depth images of different frames. In this example, a third calculator may calculate a view transform vector between the color camera and the depth camera using the view transform vector between the color images and the view transform vector between the depth images.

    摘要翻译: 图像处理装置的第一计算器可以跟踪不同帧的彩色图像之间的视图变换向量。 第二计算器可以跟踪不同帧的深度图像之间的视图变换向量。 在该示例中,第三计算器可以使用彩色图像与深度图像之间的视图变换矢量之间的视角变换矢量来计算彩色摄像机和深度摄像机之间的视图变换矢量。