Real-time performance capture with on-the-fly correctives
    1.
    发明授权
    Real-time performance capture with on-the-fly correctives 有权
    实时性能捕捉与即时校正

    公开(公告)号:US09317954B2

    公开(公告)日:2016-04-19

    申请号:US14141348

    申请日:2013-12-26

    摘要: Techniques for facial performance capture using an adaptive model are provided herein. For example, a computer-implemented method may include obtaining a three-dimensional scan of a subject and a generating customized digital model including a set of blendshapes using the three-dimensional scan, each of one or more blendshapes of the set of blendshapes representing at least a portion of a characteristic of the subject. The method may further include receiving input data of the subject, the input data including video data and depth data, tracking body deformations of the subject by fitting the input data using one or more of the blendshapes of the set, and fitting a refined linear model onto the input data using one or more adaptive principal component analysis shapes.

    摘要翻译: 本文提供了使用自适应模型进行面部表情捕获的技术。 例如,计算机实现的方法可以包括获得对象的三维扫描以及生成定制的数字模型,其包括使用三维扫描的一组混合形状的形状,所述一组混合形状的一个或多个混合形状的每一个表示在 受试者的特征的至少一部分。 该方法还可以包括通过使用集合的一个或多个混合形状来拟合输入数据来接收对象的输入数据,包括视频数据和深度数据的输入数据,跟踪身体变形,以及拟合精细线性模型 使用一个或多个自适应主成分分析形状到输入数据上。

    VISUAL TRACKING FRAMEWORK
    2.
    发明申请
    VISUAL TRACKING FRAMEWORK 审中-公开
    视觉跟踪框架

    公开(公告)号:US20140219499A1

    公开(公告)日:2014-08-07

    申请号:US14071380

    申请日:2013-11-04

    IPC分类号: G06K9/00

    摘要: A computer program product tangibly embodied in a computer-readable storage medium includes instructions that when executed by a processor perform a method. The method includes identifying a frame of a video sequence, transforming a model into an initial guess for how the region appears in the frame, performing an exhaustive search of the frame, performing a plurality of optimization procedures, wherein at least one additional model parameter is taken into account as each subsequent optimization procedure is initiated. A system includes a computer readable storage medium, a graphical user interface, an input device, a model for texture and shape of the region, the model generated using the video sequence and stored in the computer readable storage medium, and a solver component.

    摘要翻译: 有形地体现在计算机可读存储介质中的计算机程序产品包括当由处理器执行时执行方法的指令。 该方法包括识别视频序列的帧,将模型变换成如何区域出现在帧中的初始猜测,执行帧的穷尽搜索,执行多个优化过程,其中至少一个附加模型参数是 考虑到每个随后的优化过程被启动。 系统包括计算机可读存储介质,图形用户界面,输入设备,用于区域的纹理和形状的模型,使用视频序列生成并存储在计算机可读存储介质中的模型以及求解器组件。

    Visual tracking framework
    3.
    发明授权
    Visual tracking framework 有权
    视觉跟踪框架

    公开(公告)号:US09002064B2

    公开(公告)日:2015-04-07

    申请号:US14071380

    申请日:2013-11-04

    摘要: A computer program product tangibly embodied in a computer-readable storage medium includes instructions that when executed by a processor perform a method. The method includes identifying a frame of a video sequence, transforming a model into an initial guess for how the region appears in the frame, performing an exhaustive search of the frame, performing a plurality of optimization procedures, wherein at least one additional model parameter is taken into account as each subsequent optimization procedure is initiated. A system includes a computer readable storage medium, a graphical user interface, an input device, a model for texture and shape of the region, the model generated using the video sequence and stored in the computer readable storage medium, and a solver component.

    摘要翻译: 有形地体现在计算机可读存储介质中的计算机程序产品包括当由处理器执行时执行方法的指令。 该方法包括识别视频序列的帧,将模型变换成如何区域出现在帧中的初始猜测,执行帧的穷尽搜索,执行多个优化过程,其中至少一个附加模型参数是 考虑到每个随后的优化过程被启动。 系统包括计算机可读存储介质,图形用户界面,输入设备,用于区域的纹理和形状的模型,使用视频序列生成并存储在计算机可读存储介质中的模型以及求解器组件。