APPARATUS AND METHOD FOR CREATING ANIMATION BY CAPTURING MOVEMENTS OF NON-RIGID OBJECTS
    1.
    发明申请
    APPARATUS AND METHOD FOR CREATING ANIMATION BY CAPTURING MOVEMENTS OF NON-RIGID OBJECTS 审中-公开
    通过捕获非刚体对象的运动创建动画的装置和方法

    公开(公告)号:US20120154393A1

    公开(公告)日:2012-06-21

    申请号:US13333825

    申请日:2011-12-21

    IPC分类号: G06T13/00 G06T15/00

    CPC分类号: G06T13/40 G06T7/251 G06T17/20

    摘要: Disclosed herein are an apparatus and method for creating animation by capturing the motions of a non-rigid object. The apparatus includes a geometry mesh reconstruction unit, a motion capture unit, and a content creation unit. The geometry mesh reconstruction unit receives moving images captured by a plurality of cameras, and generates a reconstruction mesh set for each frame. The motion capture unit generates mesh graph sets for the reconstruction mesh set and generates motion data, including motion information, using the mesh graph sets. The content creation unit creates three-dimensional (3D) content for a non-rigid object by generating a final transformation mesh set, having a topology similar to that of the reconstruction mesh set, using the motion data.

    摘要翻译: 本文公开了一种通过捕获非刚性对象的运动来创建动画的装置和方法。 该装置包括几何网格重建单元,运动捕捉单元和内容创建单元。 几何网格重建单元接收由多个摄像机拍摄的运动图像,并为每个帧生成重建网格集。 运动捕捉单元生成用于重建网格集的网格图集,并使用网格图集生成运动数据,包括运动信息。 内容创建单元通过使用运动数据生成具有类似于重建网格集的拓扑的拓扑结构的最终变换网格集,来为非刚性对象创建三维(3D)内容。

    Method for tracking head motion for 3D facial model animation from video stream
    3.
    发明申请
    Method for tracking head motion for 3D facial model animation from video stream 审中-公开
    用于从视频流追踪3D面部模型动画的头部运动的方法

    公开(公告)号:US20090153569A1

    公开(公告)日:2009-06-18

    申请号:US12314859

    申请日:2008-12-17

    IPC分类号: G06T15/70 G06K9/00

    摘要: A head motion tracking method for three-dimensional facial model animation, the head motion tracking method includes acquiring initial facial motion to be fit to an image of a three-dimensional model from an image inputted by a video camera; creating a silhouette of the three-dimensional model and projecting the silhouette; matching the silhouette created from the three-dimensional model with a silhouette acquired by a statistical feature point tracking scheme; and obtaining a motion parameter for the image of the three-dimensional model through motion correction using a texture to perform three-dimensional head motion tracking. In accordance with the present invention, natural three-dimensional facial model animation based on a real image acquired with a video camera can be performed automatically, thereby reducing time and cost.

    摘要翻译: 一种用于三维面部模型动画的头部运动跟踪方法,所述头部运动跟踪方法包括从由摄像机输入的图像获取拟合到三维模型的图像的初始面部运动; 创建三维模型的轮廓并投影轮廓; 将由三维模型创建的轮廓与通过统计特征点跟踪方案获取的轮廓相匹配; 并且通过使用纹理的运动校正来获得三维模型的图像的运动参数,以执行三维头部运动跟踪。 根据本发明,可以自动执行基于用摄像机获取的真实图像的自然三维面部模型动画,从而减少时间和成本。

    SYSTEM AND METHOD FOR GENERATING 3-D FACIAL MODEL AND ANIMATION USING ONE VIDEO CAMERA
    4.
    发明申请
    SYSTEM AND METHOD FOR GENERATING 3-D FACIAL MODEL AND ANIMATION USING ONE VIDEO CAMERA 审中-公开
    使用一个视频摄像机生成三维面部模型和动画的系统和方法

    公开(公告)号:US20080136814A1

    公开(公告)日:2008-06-12

    申请号:US11945330

    申请日:2007-11-27

    IPC分类号: G06T15/00

    CPC分类号: G06T13/40

    摘要: Provided are system and method for generating a 3D facial model and animation using one video camera. The system includes a pre-processing part, a facial model generating part, a transferring part, a projecting part, an error calculating part, and a mesh transforming part. The pre-processing part sets correspondence relations with other meshes, generates an average 3D facial model, and generates a geometrical model and a texture dispersion model. The facial model generating part projects the average 3D facial onto an expressionless facial image frame that stares a front side to generate a performer's 3D facial model. The transferring part transfers a 3D facial model template having an animation-controlled model to the performer's 3D facial model to generate the performer's 3D facial model. The projecting part projects the performer's 3D facial model onto a facial animation video frame including a facial expression. The error calculating part calculates an error projected by the projecting part. The mesh transforming part moves or rotationally converts a joint in such a direction as to minimize the error.

    摘要翻译: 提供了使用一个摄像机生成3D面部模型和动画的系统和方法。 该系统包括预处理部分,面部模型生成部分,传送部分,投影部分,误差计算部分和网格变换部分。 预处理部分设置与其他网格的对应关系,生成平均3D面部模型,并生成几何模型和纹理分散模型。 面部模型生成部分将平均3D面部投射到无表情的面部图像框架上,该面部图像框架凝视前侧以产生表演者的3D面部模型。 传送部分将具有动画控制模型的3D面部模型模板传送到执行者的3D面部模型以生成表演者的3D面部模型。 投影部分将表演者的3D面部模型投影到包括面部表情的面部动画视频帧。 误差计算部分计算由投影部分投射的误差。 网格变换部件沿着使误差最小化的方向移动或旋转地转换关节。

    Method and system for producing 3D facial animation
    6.
    发明授权
    Method and system for producing 3D facial animation 有权
    制作3D面部动画的方法和系统

    公开(公告)号:US08259102B2

    公开(公告)日:2012-09-04

    申请号:US12314785

    申请日:2008-12-16

    IPC分类号: G06T15/70

    CPC分类号: G06T13/40

    摘要: A method for producing a 3D facial animation using a single facial video stream, includes producing a representative joint focused on a major expression producing element in a 3D standard facial model, producing a statistical feature-point model of various facial expressions of different people in the 3D standard facial model, moving each feature-point of the statistical feature-point model by tracking a change in facial expressions of the video stream, calculating a transformation coefficient of the representative joint corresponding to a variation of the feature-point of the 3D standard facial model, and producing a 3D facial animation by applying the calculated transformation coefficient to transform the representative joint.

    摘要翻译: 一种用于使用单个面部视频流生成3D面部动画的方法,包括:在3D标准面部模型中产生聚焦在主要表现形成元素上的代表性关节,产生不同人物的各种面部表情的统计特征点模型 3D标准面部模型,通过跟踪视频流的面部表情的变化来移动统计特征点模型的每个特征点,计算与3D标准的特征点的变化相对应的代表关节的变换系数 面部模型,并通过应用计算的变换系数来转换代表性关节来产生3D面部动画。

    MULTI-VIEW CAMERA COLOR CALIBRATION METHOD USING COLOR CHECKER CHART
    8.
    发明申请
    MULTI-VIEW CAMERA COLOR CALIBRATION METHOD USING COLOR CHECKER CHART 审中-公开
    多色摄像机彩色校正方法使用颜色检查器图

    公开(公告)号:US20090153745A1

    公开(公告)日:2009-06-18

    申请号:US12334095

    申请日:2008-12-12

    IPC分类号: H04N9/68

    摘要: A multi-view camera color calibration method using a color checker chart, includes measuring a brightness range of photographic data being input from multiple cameras; photographing the color checker chart for each camera and adjusting a brightness value of the chart to be within the brightness range of an input image of each camera; correcting brightness of each camera by using a gray patch of the checker chart; modeling a relationship between a color value of the checker chart obtained by each camera and a standard color value provided by the color checker chart; and correcting differences in color as a result of the modeling, to calibrate colors among the multiple cameras. Therefore, the three-dimensional information of a moving object for photography which cannot be photographed by moving only one camera is capable of being restored.

    摘要翻译: 使用颜色检查图的多视点相机颜色校准方法包括测量从多个相机输入的照片数据的亮度范围; 拍摄每个相机的颜色检查图,并将图表的亮度值调整在每个相机的输入图像的亮度范围内; 通过使用格子图的灰色补丁校正每个相机的亮度; 建模由每个相机获得的检查图的颜色值与由颜色检查图提供的标准颜色值之间的关系; 并且通过建模来校正颜色差异,以校准多个相机之间的颜色。 因此,能够恢复不能通过仅移动一个照相机而拍摄的摄影用移动物体的三维信息。

    Method and apparatus for accuracy measuring of 3D graphical model using images
    9.
    发明申请
    Method and apparatus for accuracy measuring of 3D graphical model using images 审中-公开
    使用图像对3D图形模型进行精度测量的方法和装置

    公开(公告)号:US20090153673A1

    公开(公告)日:2009-06-18

    申请号:US12314855

    申请日:2008-12-17

    IPC分类号: H04N5/225 G06T17/00

    CPC分类号: G06T7/001 G06T15/00

    摘要: Disclosed is a technology for measuring a degree of accuracy of a 3D graphical model by using images. The technology includes creating camera parameters by calculating a position, a direction, and intrinsic parameters of a camera through a calibration of the camera to a reference image which is photographed for reference during creation of the 3D graphical model of an actually existing object; calculating a position and a direction of the 3D graphical model based on a corresponding relation between the reference image and 3D graphical model data obtained by digitizing the actually existing object; creating a synthesized image by rendering the 3D graphical model using the camera parameters; extracting characteristics of the reference image and the synthesized image; and calculating distance and length errors based on a corresponding relation between the extracted characteristics of the two images.

    摘要翻译: 公开了一种通过使用图像来测量3D图形模型的精度的技术。 该技术包括通过将照相机的校准计算到相机的位置,方向和固有参数来创建相机参数,以参考图像,该参考图像在实际存在的对象的3D图形模型的创建期间被拍照以供参考; 基于通过数字化实际存在的对象获得的参考图像和3D图形模型数据之间的对应关系来计算3D图形模型的位置和方向; 通过使用相机参数渲染3D图形模型来创建合成图像; 提取参考图像和合成图像的特征; 并且基于提取的两个图像的特征之间的对应关系来计算距离和长度误差。

    Method and system for producing 3D facial animation
    10.
    发明申请
    Method and system for producing 3D facial animation 有权
    制作3D面部动画的方法和系统

    公开(公告)号:US20090153554A1

    公开(公告)日:2009-06-18

    申请号:US12314785

    申请日:2008-12-16

    IPC分类号: G06T15/70

    CPC分类号: G06T13/40

    摘要: A method for producing a 3D facial animation using a single facial video stream, includes producing a representative joint focused on a major expression producing element in a 3D standard facial model, producing a statistical feature-point model of various facial expressions of different people in the 3D standard facial model, moving each feature-point of the statistical feature-point model by tracking a change in facial expressions of the video stream, calculating a transformation coefficient of the representative joint corresponding to a variation of the feature-point of the 3D standard facial model, and producing a 3D facial animation by applying the calculated transformation coefficient to transform the representative joint.

    摘要翻译: 一种用于使用单个面部视频流生成3D面部动画的方法,包括:在3D标准面部模型中产生聚焦在主要表现形成元素上的代表性关节,产生不同人物的各种面部表情的统计特征点模型 3D标准面部模型,通过跟踪视频流的面部表情的变化来移动统计特征点模型的每个特征点,计算与3D标准的特征点的变化相对应的代表关节的变换系数 面部模型,并通过应用计算的变换系数来转换代表性关节来产生3D面部动画。