-
公开(公告)号:US09317954B2
公开(公告)日:2016-04-19
申请号:US14141348
申请日:2013-12-26
发明人: Hao Li , Jihun Yu , Yuting Ye , Christoph Bregler
CPC分类号: G06T13/40 , G06K9/00214 , G06K9/00308 , G06K9/6247 , G06T7/251 , G06T2207/10016 , G06T2207/10028 , G06T2207/20076 , G06T2207/30201
摘要: Techniques for facial performance capture using an adaptive model are provided herein. For example, a computer-implemented method may include obtaining a three-dimensional scan of a subject and a generating customized digital model including a set of blendshapes using the three-dimensional scan, each of one or more blendshapes of the set of blendshapes representing at least a portion of a characteristic of the subject. The method may further include receiving input data of the subject, the input data including video data and depth data, tracking body deformations of the subject by fitting the input data using one or more of the blendshapes of the set, and fitting a refined linear model onto the input data using one or more adaptive principal component analysis shapes.
摘要翻译: 本文提供了使用自适应模型进行面部表情捕获的技术。 例如,计算机实现的方法可以包括获得对象的三维扫描以及生成定制的数字模型,其包括使用三维扫描的一组混合形状的形状,所述一组混合形状的一个或多个混合形状的每一个表示在 受试者的特征的至少一部分。 该方法还可以包括通过使用集合的一个或多个混合形状来拟合输入数据来接收对象的输入数据,包括视频数据和深度数据的输入数据,跟踪身体变形,以及拟合精细线性模型 使用一个或多个自适应主成分分析形状到输入数据上。
-
公开(公告)号:US20140219499A1
公开(公告)日:2014-08-07
申请号:US14071380
申请日:2013-11-04
发明人: Christoph Bregler , Kiran S. Bhat , Brett A. Allen
IPC分类号: G06K9/00
CPC分类号: G06K9/00624 , G06K9/00248 , G06K9/3216 , G06K2009/3225 , G06K2009/366 , G06T7/251 , G06T2207/30201 , G06T2207/30204
摘要: A computer program product tangibly embodied in a computer-readable storage medium includes instructions that when executed by a processor perform a method. The method includes identifying a frame of a video sequence, transforming a model into an initial guess for how the region appears in the frame, performing an exhaustive search of the frame, performing a plurality of optimization procedures, wherein at least one additional model parameter is taken into account as each subsequent optimization procedure is initiated. A system includes a computer readable storage medium, a graphical user interface, an input device, a model for texture and shape of the region, the model generated using the video sequence and stored in the computer readable storage medium, and a solver component.
摘要翻译: 有形地体现在计算机可读存储介质中的计算机程序产品包括当由处理器执行时执行方法的指令。 该方法包括识别视频序列的帧,将模型变换成如何区域出现在帧中的初始猜测,执行帧的穷尽搜索,执行多个优化过程,其中至少一个附加模型参数是 考虑到每个随后的优化过程被启动。 系统包括计算机可读存储介质,图形用户界面,输入设备,用于区域的纹理和形状的模型,使用视频序列生成并存储在计算机可读存储介质中的模型以及求解器组件。
-
公开(公告)号:US09002064B2
公开(公告)日:2015-04-07
申请号:US14071380
申请日:2013-11-04
发明人: Christoph Bregler , Kiran S. Bhat , Brett A. Allen
CPC分类号: G06K9/00624 , G06K9/00248 , G06K9/3216 , G06K2009/3225 , G06K2009/366 , G06T7/251 , G06T2207/30201 , G06T2207/30204
摘要: A computer program product tangibly embodied in a computer-readable storage medium includes instructions that when executed by a processor perform a method. The method includes identifying a frame of a video sequence, transforming a model into an initial guess for how the region appears in the frame, performing an exhaustive search of the frame, performing a plurality of optimization procedures, wherein at least one additional model parameter is taken into account as each subsequent optimization procedure is initiated. A system includes a computer readable storage medium, a graphical user interface, an input device, a model for texture and shape of the region, the model generated using the video sequence and stored in the computer readable storage medium, and a solver component.
摘要翻译: 有形地体现在计算机可读存储介质中的计算机程序产品包括当由处理器执行时执行方法的指令。 该方法包括识别视频序列的帧,将模型变换成如何区域出现在帧中的初始猜测,执行帧的穷尽搜索,执行多个优化过程,其中至少一个附加模型参数是 考虑到每个随后的优化过程被启动。 系统包括计算机可读存储介质,图形用户界面,输入设备,用于区域的纹理和形状的模型,使用视频序列生成并存储在计算机可读存储介质中的模型以及求解器组件。
-
-