Apparatus and method for extracting correspondences between aerial images
    1.
    发明授权
    Apparatus and method for extracting correspondences between aerial images 有权
    提取航空图像对应的装置和方法

    公开(公告)号:US09390330B2

    公开(公告)日:2016-07-12

    申请号:US13325957

    申请日:2011-12-14

    IPC分类号: G06K9/00 G06T17/05 G06T7/00

    摘要: Disclosed herein is an apparatus and method for extracting correspondences between aerial images. The apparatus includes a line extraction unit, a line direction determination unit, a building top area extraction unit, and a correspondence extraction unit. The line extraction unit extracts lines corresponding buildings from aerial images. The line direction determination unit defines the directions of the lines as x, y and z axis directions based on a two-dimensional (2D) coordinate system. The building top area extraction unit rotates lines in the x and y axis directions so that the lines are arranged in parallel with the horizontal and vertical directions of the 2D image, and then extracts building top areas from rectangles. The correspondence extraction unit extracts correspondences between the aerial images by comparing the locations of the building top areas extracted from the aerial images.

    摘要翻译: 本文公开了一种用于提取航空图像之间的对应关系的装置和方法。 该设备包括线提取单元,线路方向确定单元,建筑物顶部区域提取单元和对应提取单元。 线提取单元从航空图像提取相应建筑物的线。 线方向确定单元基于二维(2D)坐标系,将线的方向定义为x,y和z轴方向。 建筑顶部区域提取单元沿x和y轴方向旋转线,使得线与2D图像的水平和垂直方向平行排列,然后从矩形中提取建筑顶部区域。 对应提取单元通过比较从空中图像提取的建筑物顶部区域的位置来提取空间图像之间的对应关系。

    Method and apparatus for reconstructing 3D shape model of object by using multi-view image information
    2.
    发明授权
    Method and apparatus for reconstructing 3D shape model of object by using multi-view image information 有权
    使用多视图图像信息重建物体的3D形状模型的方法和装置

    公开(公告)号:US08270704B2

    公开(公告)日:2012-09-18

    申请号:US12314678

    申请日:2008-12-15

    IPC分类号: G06K9/00 G06T15/00 H04N13/00

    CPC分类号: G06T17/20 G06T15/205

    摘要: A method for reconstructing a 3D shape model of an object by using multi-view image information, includes: inputting multi-view images obtained by photographing the object from multiple viewpoints in a voxel space, and extracting silhouette information and color information of the multi-view images; reconstructing visual hulls by silhouette intersection using the silhouette information; and approximating polygons of cross-sections of the visual hulls to a natural geometric shape of the object by using the color information. Further, the method includes expressing a 3D geometric shape of the object by connecting the approximated polygons to create a mesh structure; extracting color textures of a surface of the object by projecting meshes of the mesh structure to the multi-view image; and creating a 3D shape model by modeling natural shape information and surface color information of the object.

    摘要翻译: 一种用于通过使用多视点图像信息来重建对象的3D形状模型的方法包括:输入通过在体素空间中从多个视点拍摄对象而获得的多视图图像,以及提取多视点图像信息的轮廓信息和颜色信息, 查看图像; 使用剪影信息通过剪影交点重建视觉船体; 以及通过使用颜色信息将视觉外壳的横截面的多边形近似为对象的自然几何形状。 此外,该方法包括通过连接近似多边形以形成网格结构来表达对象的3D几何形状; 通过将网格结构的网格投影到多视点图像来提取对象的表面的颜色纹理; 以及通过对对象的自然形状信息和表面颜色信息进行建模来创建3D形状模型。

    METHOD AND APPARATUS FOR AUTOMATIC CONTROL OF MULTIPLE CAMERAS
    3.
    发明申请
    METHOD AND APPARATUS FOR AUTOMATIC CONTROL OF MULTIPLE CAMERAS 有权
    多摄像机自动控制方法与装置

    公开(公告)号:US20110149093A1

    公开(公告)日:2011-06-23

    申请号:US12862963

    申请日:2010-08-25

    IPC分类号: H04N5/225

    CPC分类号: H04N5/247

    摘要: Disclosed are an apparatus and a method for automatic control of multiple cameras capable of supporting an effective camera view angle in a broadcast, a movie, etc. The automatic control apparatus of multiple cameras includes: a first main camera; a first camera driver controlling an operation of the first main camera; a second main camera; a second camera driver controlling an operation of the second main camera; at least one auxiliary camera; at least one third camera driver controlling an operation of the at least one auxiliary camera; and an interoperation processor changing a view angle of the at least one auxiliary camera by controlling the at least one third camera driver in accordance with a view angle changing reference changed by changing the view angle of the first main camera, the second main camera, or the first and second main cameras.

    摘要翻译: 公开了一种用于自动控制能够支持广播,电影等中的有效摄像机视角的多个摄像机的装置和方法。多个摄像机的自动控制装置包括:第一主摄像机; 控制第一主摄像机的操作的第一摄像机驱动器; 第二主摄像头; 控制第二主摄像机的操作的第二摄像机驱动器; 至少一个辅助摄像机; 控制所述至少一个辅助摄像机的操作的至少一个第三摄像机驱动器; 以及互操作处理器,通过根据通过改变第一主摄像机,第二主摄像机或第二摄像机的视角改变的视角改变参考来控制至少一个第三摄像机驱动器来改变至少一个辅助摄像机的视角 第一和第二主摄像头。

    PORTABLE MULTI-VIEW IMAGE ACQUISITION SYSTEM AND MULTI-VIEW IMAGE PREPROCESSING METHOD
    4.
    发明申请
    PORTABLE MULTI-VIEW IMAGE ACQUISITION SYSTEM AND MULTI-VIEW IMAGE PREPROCESSING METHOD 审中-公开
    便携式多视图图像采集系统和多视图图像预处理方法

    公开(公告)号:US20110149074A1

    公开(公告)日:2011-06-23

    申请号:US12971727

    申请日:2010-12-17

    IPC分类号: H04N7/18

    CPC分类号: H04N7/181

    摘要: Provided are a portable multi-view image acquisition system and a multi-view image preprocessing method. The portable multi-view image acquisition system may include: a portable studio including a plurality of cameras movable up, down, left and right; and a preprocessor performing a preprocessing including a subject separation from a multi-view image that is photographed by the plurality of cameras.

    摘要翻译: 提供了便携式多视图图像采集系统和多视图图像预处理方法。 便携式多视点图像采集系统可以包括:便携式演播室,包括可上下移动,左右移动的多个相机; 以及预处理器,其执行包括由多个摄像机拍摄的多视点图像的对象分离的预处理。

    THREE-DIMENSIONAL URBAN MODELING APPARATUS AND METHOD
    5.
    发明申请
    THREE-DIMENSIONAL URBAN MODELING APPARATUS AND METHOD 有权
    三维城市建模设备及方法

    公开(公告)号:US20110148866A1

    公开(公告)日:2011-06-23

    申请号:US12971162

    申请日:2010-12-17

    IPC分类号: G06T17/00

    CPC分类号: G06T17/05 G06T15/04

    摘要: Disclosed herein is a 3D urban modeling apparatus and method. The 3D urban modeling apparatus includes a calibration unit for calibrating data about a translation and a rotation of at least one capturing device at a time that input aerial images and terrestrial images were captured. A building model generation unit generates at least one 3D building model based on the aerial images and the terrestrial images to which results of the calibration have been applied. A terrain model generation unit generates a 3D terrain model by converting an input digital elevation model into a 3D mesh. A texture extraction unit extracts textures related to the building model and the terrain model from the aerial images and the terrestrial images. A model matching unit generates a 3D urban model by matching the building model with the terrain model, which are based on the textures, with each other.

    摘要翻译: 本文公开了一种3D城市建模装置和方法。 3D城市建模装置包括校准单元,用于在输入空间图像和地面图像的时间校准关于平移的数据和至少一个捕获装置的旋转。 建筑模型生成单元基于空间图像和已经应用校准结果的地面图像生成至少一个3D建筑模型。 地形模型生成单元通过将输入数字高程模型转换为3D网格来生成3D地形模型。 纹理提取单元从空中图像和地面图像中提取与建筑模型和地形模型相关的纹理。 模型匹配单元通过将建筑模型与基于纹理的地形模型相互匹配来生成3D城市模型。

    Apparatus and method for determining stereo disparity based on two-path dynamic programming and GGCP
    7.
    发明授权
    Apparatus and method for determining stereo disparity based on two-path dynamic programming and GGCP 有权
    基于双路径动态规划和GGCP来确定立体视差的装置和方法

    公开(公告)号:US07570804B2

    公开(公告)日:2009-08-04

    申请号:US11296788

    申请日:2005-12-07

    CPC分类号: G06K9/6206 G06K9/32 G06T7/30

    摘要: Provided is an apparatus and method for determining stereo disparity based on two-path dynamic programming and GGCP. The apparatus includes a pre-processing unit for analyzing texture distribution of an input image by using a Laplacian of Gaussian (LOG) filter and dividing the input image into a homogeneous region and a non-homogeneous region; a local matching unit for determining candidate disparities to be included in an each pixel of all pixels; a local post-processing unit for removing candidate disparities in a pixel of low reliability by performing a visibility test betweens candidate disparities in each pixel to improve the reliability of the candidate disparity; and a global optimizing unit for determining a final disparity for candidate disparities in an each pixel by performing a dynamic programming.

    摘要翻译: 提供了一种基于双向动态规划和GGCP来确定立体视差的装置和方法。 该装置包括:预处理单元,用于通过使用拉普拉斯高斯(LOG)滤波器并将输入图像划分成均匀区域和非均匀区域来分析输入图像的纹理分布; 用于确定要包括在所有像素的每个像素中的候选差异的局部匹配单元; 本地后处理单元,用于通过在每个像素中执行候选差异之间的可见性测试来提高候选视差的可靠性来消除低可靠性像素中的候选差异; 以及全局优化单元,用于通过执行动态规划来确定每个像素中候选差距的最终差异。

    Method for tracking head motion for 3D facial model animation from video stream
    8.
    发明申请
    Method for tracking head motion for 3D facial model animation from video stream 审中-公开
    用于从视频流追踪3D面部模型动画的头部运动的方法

    公开(公告)号:US20090153569A1

    公开(公告)日:2009-06-18

    申请号:US12314859

    申请日:2008-12-17

    IPC分类号: G06T15/70 G06K9/00

    摘要: A head motion tracking method for three-dimensional facial model animation, the head motion tracking method includes acquiring initial facial motion to be fit to an image of a three-dimensional model from an image inputted by a video camera; creating a silhouette of the three-dimensional model and projecting the silhouette; matching the silhouette created from the three-dimensional model with a silhouette acquired by a statistical feature point tracking scheme; and obtaining a motion parameter for the image of the three-dimensional model through motion correction using a texture to perform three-dimensional head motion tracking. In accordance with the present invention, natural three-dimensional facial model animation based on a real image acquired with a video camera can be performed automatically, thereby reducing time and cost.

    摘要翻译: 一种用于三维面部模型动画的头部运动跟踪方法,所述头部运动跟踪方法包括从由摄像机输入的图像获取拟合到三维模型的图像的初始面部运动; 创建三维模型的轮廓并投影轮廓; 将由三维模型创建的轮廓与通过统计特征点跟踪方案获取的轮廓相匹配; 并且通过使用纹理的运动校正来获得三维模型的图像的运动参数,以执行三维头部运动跟踪。 根据本发明,可以自动执行基于用摄像机获取的真实图像的自然三维面部模型动画,从而减少时间和成本。

    Method for generating 3D mesh based on unorganized sparse 3D points
    9.
    发明授权
    Method for generating 3D mesh based on unorganized sparse 3D points 有权
    基于无组织稀疏3D点生成3D网格的方法

    公开(公告)号:US07456831B2

    公开(公告)日:2008-11-25

    申请号:US11205427

    申请日:2005-08-17

    IPC分类号: G06T17/00

    CPC分类号: G06T17/20

    摘要: Provided is a method for generating a three-dimensional (3D) mesh based on unorganized sparse 3D points to generate a mesh model that displays a 3D surface by using unorganized sparse 3D points extracted from a plurality of two-dimensional image. The 3D mesh generating method based on unorganized sparse 3D points includes the steps of: receiving a plurality of unorganized sparse 3D points, a plurality of two-dimensional (2D) corresponding point information, and images; generating an initial mesh by using the received 2D corresponding information; removing an abnormal face from the initial mesh; checking if unused 2D corresponding point information exists among the received 2D corresponding point information; if unused 2D corresponding point information exists, reorganizing the initial mesh by performing a constrained Delaunay triangulation; and if unused 2D corresponding point information does not exist in the result of the confirmation, generating a final mesh.

    摘要翻译: 提供了一种用于基于无组织稀疏3D点生成三维(3D)网格的方法,以生成通过使用从多个二维图像提取的未组织的稀疏3D点来显示3D表面的网格模型。 基于无组织稀疏3D点的3D网格生成方法包括以下步骤:接收多个无组织稀疏3D点,多个二维(2D)对应点信息和图像; 通过使用接收到的2D对应信息来生成初始网格; 从初始网格去除异常的脸部; 在接收到的2D对应点信息中检查是否存在未使用的2D对应点信息; 如果未使用2D对应点信息,则通过执行约束Delaunay三角测量重组初始网格; 并且如果在确认结果中不存在未使用的2D对应点信息,则生成最终网格。

    SYSTEM AND METHOD FOR GENERATING 3-D FACIAL MODEL AND ANIMATION USING ONE VIDEO CAMERA
    10.
    发明申请
    SYSTEM AND METHOD FOR GENERATING 3-D FACIAL MODEL AND ANIMATION USING ONE VIDEO CAMERA 审中-公开
    使用一个视频摄像机生成三维面部模型和动画的系统和方法

    公开(公告)号:US20080136814A1

    公开(公告)日:2008-06-12

    申请号:US11945330

    申请日:2007-11-27

    IPC分类号: G06T15/00

    CPC分类号: G06T13/40

    摘要: Provided are system and method for generating a 3D facial model and animation using one video camera. The system includes a pre-processing part, a facial model generating part, a transferring part, a projecting part, an error calculating part, and a mesh transforming part. The pre-processing part sets correspondence relations with other meshes, generates an average 3D facial model, and generates a geometrical model and a texture dispersion model. The facial model generating part projects the average 3D facial onto an expressionless facial image frame that stares a front side to generate a performer's 3D facial model. The transferring part transfers a 3D facial model template having an animation-controlled model to the performer's 3D facial model to generate the performer's 3D facial model. The projecting part projects the performer's 3D facial model onto a facial animation video frame including a facial expression. The error calculating part calculates an error projected by the projecting part. The mesh transforming part moves or rotationally converts a joint in such a direction as to minimize the error.

    摘要翻译: 提供了使用一个摄像机生成3D面部模型和动画的系统和方法。 该系统包括预处理部分,面部模型生成部分,传送部分,投影部分,误差计算部分和网格变换部分。 预处理部分设置与其他网格的对应关系,生成平均3D面部模型,并生成几何模型和纹理分散模型。 面部模型生成部分将平均3D面部投射到无表情的面部图像框架上,该面部图像框架凝视前侧以产生表演者的3D面部模型。 传送部分将具有动画控制模型的3D面部模型模板传送到执行者的3D面部模型以生成表演者的3D面部模型。 投影部分将表演者的3D面部模型投影到包括面部表情的面部动画视频帧。 误差计算部分计算由投影部分投射的误差。 网格变换部件沿着使误差最小化的方向移动或旋转地转换关节。