Facial motion capture using marker patterns that accommodate facial surface
    11.
    发明授权
    Facial motion capture using marker patterns that accommodate facial surface 有权
    使用适合面部表面的标记图案进行面部运动捕捉

    公开(公告)号:US08842933B2

    公开(公告)日:2014-09-23

    申请号:US12938317

    申请日:2010-11-02

    申请人: Parag Havaldar

    发明人: Parag Havaldar

    IPC分类号: G06K9/36 G06T13/40 G06T7/20

    摘要: Capturing facial surface using marker patterns laid out on the facial surface by adapting the marker patterns to contours of the facial surface and motion range of a head including: generating a facial action coding system (FACS) matrix by capturing FACS poses; generating a pattern to wrap over the facial surface using the FACS poses as a guide; capturing and tracking marker motions of the pattern; stabilizing the marker motions of the pattern using a head stabilization transform to remove head motions from the marker motions; and generating and applying a plurality of FACS matrix weights to the stabilized marker motions.

    摘要翻译: 通过使标记图案适应面部表面的轮廓和头部的运动范围来捕捉面部表面上布置的标记图案,包括:通过捕获FACS姿态来产生面部动作编码系统(FACS)矩阵; 使用FACS姿势产生用于覆盖面部表面的图案作为指导; 捕获和跟踪图案的标记运动; 使用头部稳定变换来稳定图案的标记运动,以从标记运动中去除头部运动; 以及将多个FACS矩阵权重生成并应用于所述稳定的标记运动。

    Combining multi-sensory inputs for digital animation
    12.
    发明授权
    Combining multi-sensory inputs for digital animation 有权
    结合数字动画的多感官输入

    公开(公告)号:US08736616B2

    公开(公告)日:2014-05-27

    申请号:US12883074

    申请日:2010-09-15

    IPC分类号: G06T13/00

    CPC分类号: G06T13/20 G06T11/60

    摘要: Animating digital characters based on motion captured performances, including: receiving sensory data collected using a variety of collection techniques including optical video, electro-oculography, and at least one of optical, infrared, and inertial motion capture; and managing and combining the collected sensory data to aid cleaning, tracking, labeling, and re-targeting processes. Keywords include Optical Video Data and Inertial Motion Capture.

    摘要翻译: 基于运动捕捉的性能来动画化数字字符,包括:接收使用各种收集技术收集的感觉数据,包括光学视频,电眼摄影以及光学,红外和惯性运动捕捉中的至少一种。 并管理和组合收集的感官数据,以帮助清洁,跟踪,标注和重定向过程。 关键词包括光学视频数据和惯性运动捕捉。

    FACS cleaning in motion capture
    13.
    发明授权
    FACS cleaning in motion capture 有权
    FACS清洁运动捕捉

    公开(公告)号:US07961947B2

    公开(公告)日:2011-06-14

    申请号:US11829711

    申请日:2007-07-27

    IPC分类号: G06K9/00

    摘要: A method of cleaning facial marker data, the method comprising: decimating frames of survey facial marker data into representative frames of key facial poses; generating a facial pose matrix using the representative frames of key facial poses; and cleaning incoming frames of facial marker data using the facial pose matrix.

    摘要翻译: 一种清洁面部标记数据的方法,所述方法包括:将调查面部标记数据的帧抽取成关键面部姿势的代表性帧; 使用关键面部姿态的代表性帧来生成面部姿势矩阵; 并使用面部姿势矩阵来清洁面部标记数据的传入帧。

    INTEGRATED MOTION CAPTURE
    14.
    发明申请
    INTEGRATED MOTION CAPTURE 审中-公开
    综合运动能力

    公开(公告)号:US20100315524A1

    公开(公告)日:2010-12-16

    申请号:US12676041

    申请日:2008-09-04

    IPC分类号: H04N5/228 G06K9/00

    摘要: A method including: applying a marking material having a known pattern to a body and a face of an actor; configuring at least one first video motion capture camera to capture the marking material on the body of the actor; configuring at least one second video motion capture camera to capture the marking material on the face of the actor; substantially simultaneously capturing body motion data using the at least one first video motion capture camera and facial motion data using the at least one second video motion capture camera; and integrating the body motion data and the facial motion data.

    摘要翻译: 一种方法,包括:将具有已知图案的标记材料施加到主体的身体和面部; 配置至少一个第一视频运动捕捉相机以捕获所述演员身体上的标记材料; 配置至少一个第二视频运动捕捉相机以捕获所述演员表面上的标记材料; 使用所述至少一个第一视频运动捕捉相机和使用所述至少一个第二视频运动捕捉相机的面部运动数据基本上同时捕获体动数据; 以及整合人体运动数据和面部运动数据。

    CAPTURING AND PROCESSING FACIAL MOTION DATA
    15.
    发明申请
    CAPTURING AND PROCESSING FACIAL MOTION DATA 有权
    捕捉和处理事件运动数据

    公开(公告)号:US20090324017A1

    公开(公告)日:2009-12-31

    申请号:US12547378

    申请日:2009-08-25

    IPC分类号: G06K9/00

    CPC分类号: G06K9/00255 G06T7/246

    摘要: Capturing and processing facial motion data includes: coupling a plurality of sensors to target points on a facial surface of an actor; capturing frame by frame images of the plurality of sensors disposed on the facial surface of the actor using at least one motion capture camera disposed on a head-mounted system; performing, in the head-mounted system, a tracking function on the frame by frame images of the plurality of sensors to accurately map the plurality of sensors for each frame; and generating, in the head-mounted system, a modeled surface representing the facial surface of the actor.

    摘要翻译: 捕获和处理面部运动数据包括:将多个传感器耦合到演员的面部表面上的目标点; 使用设置在头戴式系统上的至少一个运动捕捉相机来捕获布置在所述演员的面部表面上的多个传感器的逐帧图像; 在头戴式系统中,对多个传感器的逐帧图像执行跟踪功能,以准确地映射每个帧的多个传感器; 并且在头戴式系统中产生表示演员的面部表面的模型表面。

    FACS CLEANING IN MOTION CAPTURE
    16.
    发明申请
    FACS CLEANING IN MOTION CAPTURE 有权
    FACS清洁运动捕捉

    公开(公告)号:US20080025569A1

    公开(公告)日:2008-01-31

    申请号:US11829711

    申请日:2007-07-27

    IPC分类号: G09G3/36

    摘要: A method of cleaning facial marker data, the method comprising: decimating frames of survey facial marker data into representative frames of key facial poses; generating a facial pose matrix using the representative frames of key facial poses; and cleaning incoming frames of facial marker data using the facial pose matrix.

    摘要翻译: 一种清洁面部标记数据的方法,所述方法包括:将调查面部标记数据的帧抽取成关键面部姿势的代表性帧; 使用关键面部姿态的代表性帧来生成面部姿势矩阵; 并使用面部姿势矩阵来清洁面部标记数据的传入帧。

    Capturing and processing facial motion data
    18.
    发明授权
    Capturing and processing facial motion data 有权
    捕捉和处理面部动作数据

    公开(公告)号:US08218825B2

    公开(公告)日:2012-07-10

    申请号:US12547378

    申请日:2009-08-25

    IPC分类号: G06K9/00

    CPC分类号: G06K9/00255 G06T7/246

    摘要: Capturing and processing facial motion data includes: coupling a plurality of sensors to target points on a facial surface of an actor; capturing frame by frame images of the plurality of sensors disposed on the facial surface of the actor using at least one motion capture camera disposed on a head-mounted system; performing, in the head-mounted system, a tracking function on the frame by frame images of the plurality of sensors to accurately map the plurality of sensors for each frame; and generating, in the head-mounted system, a modeled surface representing the facial surface of the actor.

    摘要翻译: 捕获和处理面部运动数据包括:将多个传感器耦合到演员的面部表面上的目标点; 使用设置在头戴式系统上的至少一个运动捕捉相机来捕获布置在所述演员的面部表面上的多个传感器的逐帧图像; 在头戴式系统中,对多个传感器的逐帧图像执行跟踪功能,以准确地映射每个帧的多个传感器; 并且在头戴式系统中产生表示演员的面部表面的模型表面。

    COMBINING MULTI-SENSORY INPUTS FOR DIGITAL ANIMATION
    19.
    发明申请
    COMBINING MULTI-SENSORY INPUTS FOR DIGITAL ANIMATION 有权
    组合数字动画的多传感器输入

    公开(公告)号:US20110091070A1

    公开(公告)日:2011-04-21

    申请号:US12883074

    申请日:2010-09-15

    IPC分类号: G06K9/00

    CPC分类号: G06T13/20 G06T11/60

    摘要: Animating digital characters based on motion captured performances, including: receiving sensory data collected using a variety of collection techniques including optical video, electro-oculography, and at least one of optical, infrared, and inertial motion capture; and managing and combining the collected sensory data to aid cleaning, tracking, labeling, and re-targeting processes. Keywords include Optical Video Data and Inertial Motion Capture.

    摘要翻译: 基于运动捕捉的性能来动画化数字字符,包括:接收使用各种收集技术收集的感觉数据,包括光学视频,电眼摄影以及光学,红外和惯性运动捕捉中的至少一种。 并管理和组合收集的感官数据,以帮助清洁,跟踪,标签和重定向过程。 关键词包括光学视频数据和惯性运动捕捉。

    PERFORMANCE DRIVEN FACIAL ANIMATION
    20.
    发明申请
    PERFORMANCE DRIVEN FACIAL ANIMATION 审中-公开
    性能驾驶面试动画

    公开(公告)号:US20100045680A1

    公开(公告)日:2010-02-25

    申请号:US12424481

    申请日:2009-04-15

    IPC分类号: G06T15/70

    CPC分类号: G06T13/40

    摘要: A method of animating a digital facial model, the method including: defining a plurality of action units; calibrating each action unit of the plurality of action units via an actor's performance; capturing first facial pose data; determining a plurality of weights, each weight of the plurality of weights uniquely corresponding to the each action unit, the plurality of weights characterizing a weighted combination of the plurality of action units, the weighted combination approximating the first facial pose data; generating a weighted activation by combining the results of applying the each weight to the each action unit; applying the weighted activation to the digital facial model; and recalibrating at least one action unit of the plurality of action units using input user adjustments to the weighted activation.

    摘要翻译: 一种动画化数字面部模型的方法,所述方法包括:定义多个动作单元; 通过演员的表演来校准多个动作单元中的每个动作单元; 捕获第一面部姿势数据; 确定多个权重,所述权重唯一地对应于每个动作单元,所述多个权重表征所述多个动作单元的加权组合,所述加权组合近似所述第一面部姿势数据; 通过将应用每个权重的结果组合到每个动作单元来产生加权激活; 将加权激活应用于数字面部模型; 以及使用对所述加权激活的输入用户调整来重新校准所述多个动作单元中的至少一个动作单元。