Video method for generating free viewpoint video image using divided local regions
    1.
    发明授权
    Video method for generating free viewpoint video image using divided local regions 失效
    使用分割的本地区域生成空闲视点视频图像的视频方法

    公开(公告)号:US08243122B2

    公开(公告)日:2012-08-14

    申请号:US12182630

    申请日:2008-07-30

    IPC分类号: H04N7/00

    CPC分类号: G06T15/205

    摘要: The present invention provides a method of generating a virtual viewpoint video image when the virtual viewpoint position is not located on a plane where a camera is disposed. In an environment in which a plurality of cameras having a horizontal optical axis are disposed in a real zone (for example, on the circumference) which surrounds an object, a video image of an arbitrary viewpoint on the circumference is generated. Further, by synthesizing video images photographed by a camera, a free viewpoint video image is generated from a virtual viewpoint (viewpoint from a high or low position) where no camera is placed. According to a method of achieving this, a travel distance of a display position is calculated by the local region synthesizing portion and this travel distance is reflected to the free viewpoint video image of a local region.

    摘要翻译: 本发明提供一种当虚拟视点位置不位于相机设置的平面上时产生虚拟视点视频图像的方法。 在具有水平光轴的多个照相机设置在围绕物体的实际区域(例如,在周边)上的环境中,产生在圆周上的任意视点的视频图像。 此外,通过合成由相机拍摄的视频图像,从没有相机放置的虚拟视点(高或低位置的视点)生成自由视点视频图像。 根据这样做的方法,通过局部区域合成部分计算出显示位置的移动距离,并将该行进距离反映到局部区域的自由视点视频图像。

    Method for generating free viewpoint video image in three-dimensional movement and recording medium
    2.
    发明授权
    Method for generating free viewpoint video image in three-dimensional movement and recording medium 失效
    用于在三维运动和记录介质中产生无视点视频图像的方法

    公开(公告)号:US08259160B2

    公开(公告)日:2012-09-04

    申请号:US12488827

    申请日:2009-06-22

    IPC分类号: H04N13/02 H04N5/225

    摘要: The present invention provides a method for generating free viewpoint video image in three-dimensional movement capable of synthesizing the free viewpoint video image from a viewpoint which looks down on an object from above. This method includes a process of taking multi-viewpoint video images using a plurality of cameras located on an identical plane and a camera not located on the identical plane, a process of generating video image at a viewpoint having the same azimuth as a desired viewpoint and located on the plane from the multi-viewpoint video images of the cameras on the plane, and a process of generating video image at the desired viewpoint from video image of the camera not located on the plane and video image at the viewpoint having the same azimuth as the desired viewpoint and located on the plane.

    摘要翻译: 本发明提供了一种用于在能够从俯视物体的观点合成自由视点视频图像的三维运动中产生自由视点视频图像的方法。 该方法包括使用位于相同平面上的多个摄像机和不位于同一平面上的摄像机拍摄多视点视频图像的过程,在具有与期望视点相同的方位角的视点处产生视频图像的处理,以及 从平面上的摄像机的多视点视频图像位于平面上,以及从不位于平面上的摄像机的视频图像产生在期望视点处的视频图像的处理,并且具有相同方位角的视点 作为所需的视点并位于飞机上。

    METHOD FOR GENERATING FREE VIEWPOINT VIDEO IMAGE IN THREE-DIMENSIONAL MOVEMENT AND RECORDING MEDIUM
    3.
    发明申请
    METHOD FOR GENERATING FREE VIEWPOINT VIDEO IMAGE IN THREE-DIMENSIONAL MOVEMENT AND RECORDING MEDIUM 失效
    用于在三维运动和记录介质中生成免费视点视频图像的方法

    公开(公告)号:US20100026788A1

    公开(公告)日:2010-02-04

    申请号:US12488827

    申请日:2009-06-22

    IPC分类号: H04N13/02

    摘要: The present invention provides a method for generating free viewpoint video image in three-dimensional movement capable of synthesizing the free viewpoint video image from a viewpoint which looks down on an object from above. This method includes a process of taking multi-viewpoint video images using a plurality of cameras located on an identical plane and a camera not located on the identical plane, a process of generating video image at a viewpoint having the same azimuth as a desired viewpoint and located on the plane from the multi-viewpoint video images of the cameras on the plane, and a process of generating video image at the desired viewpoint from video image of the camera not located on the plane and video image at the viewpoint having the same azimuth as the desired viewpoint and located on the plane.

    摘要翻译: 本发明提供了一种用于在能够从俯视物体的观点合成自由视点视频图像的三维运动中产生自由视点视频图像的方法。 该方法包括使用位于相同平面上的多个摄像机和不位于同一平面上的摄像机拍摄多视点视频图像的过程,在具有与期望视点相同的方位角的视点处产生视频图像的处理,以及 从平面上的摄像机的多视点视频图像位于平面上,以及从不位于平面上的摄像机的视频图像产生在期望视点处的视频图像的处理,并且具有相同方位角的视点 作为所需的视点并位于飞机上。

    Color correction apparatus, method and computer program
    4.
    发明授权
    Color correction apparatus, method and computer program 有权
    颜色校正装置,方法和计算机程序

    公开(公告)号:US08428350B2

    公开(公告)日:2013-04-23

    申请号:US12178335

    申请日:2008-07-23

    IPC分类号: G06K9/00

    CPC分类号: H04N9/68 H04N5/247

    摘要: The present invention relates to color correction of video signals from a plurality of cameras. The apparatus has a correction order that defines a plurality of camera pairs and an order of the camera pairs, where each camera pair specifies a reference camera and a target camera. In the correction order, each camera is treated as a target camera at least one time, and the reference camera is treated as the target camera in a previous camera pair except for the first camera pair. The apparatus corrects a value of each pixel in a target image captured by the target camera based on a reference image captured by the reference camera, and replaces the target image by the corrected target image, for each camera pair in accordance with the order of the camera pairs.

    摘要翻译: 本发明涉及来自多个摄像机的视频信号的颜色校正。 该装置具有定义多个相机对的校正顺序以及相机对的顺序,其中每个相机对指定参考相机和目标相机。 在校正顺序中,将至少一次将每个摄像机视为目标摄像机,并且将参考摄像机视为除了第一摄像机对之外的先前摄像机对中的目标摄像机。 该装置基于由参考相机拍摄的参考图像来校正由目标相机捕获的目标图像中的每个像素的值,并且根据所述相机的顺序,针对每个相机对,针对每个相机对替换目标图像。 相机对。

    Calibration apparatus and method for imaging devices and computer program
    5.
    发明授权
    Calibration apparatus and method for imaging devices and computer program 有权
    用于成像装置和计算机程序的校准装置和方法

    公开(公告)号:US08164633B2

    公开(公告)日:2012-04-24

    申请号:US12350621

    申请日:2009-01-08

    IPC分类号: H04N17/00 H04N17/02

    CPC分类号: G06T7/80

    摘要: The present invention relates to calibration of camera parameters for converting a world coordinate system, which indicates a position in the real space, to a coordinate used in an image and vice versa. The apparatus according to the invention has a detection unit, which determines corresponding pixel pairs from the captured image and the model image and outputs corresponding data indicating determined pixel pairs, and a selection unit, which selects pixel pairs to be left in the corresponding data and removes data related to an unselected pixel pair from the corresponding data for generating selected corresponding data. The apparatus further has a calculation unit, which calculates camera parameters based on the selected corresponding data.

    摘要翻译: 本发明涉及用于将指示真实空间中的位置的世界坐标系转换为图像中使用的坐标的相机参数的校准,反之亦然。 根据本发明的装置具有检测单元,该检测单元从捕获的图像和模型图像确定相应的像素对,并输出指示确定的像素对的对应数据,以及选择单元,其选择要留在相应数据中的像素对,以及 从相应的数据移除与未选择的像素对有关的数据,以产生所选择的相应数据。 该装置还具有计算单元,其基于所选择的相应数据来计算摄像机参数。

    Image generating apparatus and computer program
    6.
    发明授权
    Image generating apparatus and computer program 有权
    图像生成装置和计算机程序

    公开(公告)号:US08811717B2

    公开(公告)日:2014-08-19

    申请号:US12491835

    申请日:2009-06-25

    IPC分类号: G06K9/00 G06T7/00

    摘要: The present invention relate to an image generating apparatus for generating an image from a viewpoint specified by a user. According to the invention, the apparatus has a storage unit that stores data of a plurality of images, and a disparity map generating unit that generates a disparity map. The disparity map is associated with a pair of images including a first image and a second image, and indicates corresponding pixels in the first and second images.

    摘要翻译: 本发明涉及从用户指定的视点生成图像的图像生成装置。 根据本发明,该装置具有存储多个图像的数据的存储单元和产生视差图的视差图生成单元。 视差图与包括第一图像和第二图像的一对图像相关联,并且指示第一图像和第二图像中的相应像素。

    Apparatus, method and computer program for classifying pixels in a motion picture as foreground or background
    7.
    发明授权
    Apparatus, method and computer program for classifying pixels in a motion picture as foreground or background 失效
    用于将运动图像中的像素分类为前景或背景的装置,方法和计算机程序

    公开(公告)号:US08204316B2

    公开(公告)日:2012-06-19

    申请号:US12240467

    申请日:2008-09-29

    IPC分类号: G06K9/34 G06K9/62

    摘要: The present invention relates to an apparatus and a method for classifying pixels in each frame of a motion picture as foreground or background. According to the invention, the apparatus has a decision unit and adjustment unit. The decision unit classifies a pixel as a foreground pixel, a background pixel or an undefined pixel based on a first threshold, a second threshold and a distribution value of the pixel representing an occurrence probability of a pixel value of the pixel. The decision unit sorts each pixel into a foreground pixel or a background pixel based on the classification result of the decision unit.

    摘要翻译: 本发明涉及一种用于将运动图像的每帧中的像素分类为前景或背景的装置和方法。 根据本发明,该装置具有判定单元和调整单元。 决定单元基于表示像素的像素值的出现概率的像素的第一阈值,第二阈值和分布值,将像素分类为前景像素,背景像素或未定义像素。 决策单元根据决策单元的分类结果将每个像素分类成前景像素或背景像素。

    COLOR CORRECTION APPARATUS, METHOD AND COMPUTER PROGRAM
    8.
    发明申请
    COLOR CORRECTION APPARATUS, METHOD AND COMPUTER PROGRAM 有权
    彩色校正装置,方法和计算机程序

    公开(公告)号:US20090052776A1

    公开(公告)日:2009-02-26

    申请号:US12178335

    申请日:2008-07-23

    IPC分类号: G06K9/00

    CPC分类号: H04N9/68 H04N5/247

    摘要: The present invention relates to color correction of video signals from a plurality of cameras. The apparatus has a correction order that defines a plurality of camera pairs and an order of the camera pairs, where each camera pair specifies a reference camera and a target camera. In the correction order, each camera is treated as a target camera at least one time, and the reference camera is treated as the target camera in a previous camera pair except for the first camera pair. The apparatus corrects a value of each pixel in a target image captured by the target camera based on a reference image captured by the reference camera, and replaces the target image by the corrected target image, for each camera pair in accordance with the order of the camera pairs.

    摘要翻译: 本发明涉及来自多个摄像机的视频信号的颜色校正。 该装置具有定义多个相机对的校正顺序以及相机对的顺序,其中每个相机对指定参考相机和目标相机。 在校正顺序中,将至少一次将每个摄像机视为目标摄像机,并且将参考摄像机视为除了第一摄像机对之外的先前摄像机对中的目标摄像机。 该装置基于由参考相机拍摄的参考图像来校正由目标相机捕获的目标图像中的每个像素的值,并且根据所述相机的顺序,针对每个相机对,针对每个相机对替换目标图像。 相机对。

    Alarm information display unit
    9.
    发明申请
    Alarm information display unit 失效
    报警信息显示单元

    公开(公告)号:US20070291850A1

    公开(公告)日:2007-12-20

    申请号:US11808818

    申请日:2007-06-13

    IPC分类号: H04N11/04 H04B1/66

    摘要: A plurality of cameras is placed so that those optical axes become parallel to the Z-axis and are in relative position t on the XY plane. Multi-view video compression coding apparatus determines depth distance Z and unit normal vector (nx, ny, nz) of the arbitrary point in the surface of the object, moves the first block by disparity vector based on t and Z, transforming the first block by linear transformation matrix based on t, Z and n, then, matching the first block to block of the second picture. Then, while changing Z and n arbitrarily, the second block of the second picture which is most similar to the first block is searched for. And the apparatus derives a prediction error between the first block and the second block, codes the prediction error, and adds Z and n to coded data.

    摘要翻译: 放置多个照相机,使得这些光轴变得平行于Z轴并且在XY平面上处于相对位置t。 多视点视频压缩编码装置确定对象表面中的任意点的深度距离Z和单位法向量(nx,ny,nz),基于t和Z移动第一块视差矢量,将第一块 通过基于t,Z和n的线性变换矩阵,然后匹配第一个块到第二个图像的块。 然后,在任意地改变Z和n的同时,搜索与第一块最相似的第二图像的第二块。 并且该装置导出第一块和第二块之间的预测误差,对预测误差进行编码,并将Z和n添加到编码数据。

    Multi-view video compression coding method and apparatus
    10.
    发明授权
    Multi-view video compression coding method and apparatus 失效
    多视图视频压缩编码方法和装置

    公开(公告)号:US08311089B2

    公开(公告)日:2012-11-13

    申请号:US11808818

    申请日:2007-06-13

    IPC分类号: H04B1/66

    摘要: A plurality of cameras is placed so that those optical axes become parallel to the Z-axis and are in relative position t on the XY plane. Multi-view video compression coding apparatus determines depth distance Z and unit normal vector (nx, ny, nz) of the arbitrary point in the surface of the object, moves the first block by disparity vector based on t and Z, transforming the first block by linear transformation matrix based on t, Z and n, then, matching the first block to block of the second picture. Then, while changing Z and n arbitrarily, the second block of the second picture which is most similar to the first block is searched for. And the apparatus derives a prediction error between the first block and the second block, codes the prediction error, and adds Z and n to coded data.

    摘要翻译: 放置多个照相机,使得这些光轴变得平行于Z轴并且在XY平面上处于相对位置t。 多视点视频压缩编码装置确定对象表面中的任意点的深度距离Z和单位法向量(nx,ny,nz),基于t和Z移动第一块视差矢量,将第一块 通过基于t,Z和n的线性变换矩阵,然后匹配第一个块到第二个图像的块。 然后,在任意地改变Z和n的同时,搜索与第一块最相似的第二图像的第二块。 并且该装置导出第一块和第二块之间的预测误差,对预测误差进行编码,并将Z和n添加到编码数据。