Facial animation models
    1.
    发明授权

    公开(公告)号:US10964083B1

    公开(公告)日:2021-03-30

    申请号:US16380653

    申请日:2019-04-10

    IPC分类号: G06T13/40

    摘要: A system includes a computing device that includes a memory configured to store instructions. The system also includes a processor configured to execute the instructions to perform a method that includes receiving multiple representations of one or more expressions of an object. Each of the representations includes position information attained from one or more images of the object. The method also includes producing an animation model from one or more groups of controls that respectively define each of the one or more expressions of the object as provided by the multiple representations. Each control of each group of controls has an adjustable value that defines the geometry of at least one shape of a portion of the respective expression of the object. Producing the animation model includes producing one or more corrective shapes if the animation model is incapable of accurately presenting the one or more expressions of the object as provided by the multiple representations.

    Controlling animated character expression
    2.
    发明授权
    Controlling animated character expression 有权
    控制动画角色表达式

    公开(公告)号:US09256973B2

    公开(公告)日:2016-02-09

    申请号:US14139409

    申请日:2013-12-23

    CPC分类号: G06T11/60 G06T13/40 G06T13/80

    摘要: A system includes a computer system capable of representing one or more animated characters. The computer system includes a blendshape manager that combines multiple blendshapes to produce the animated character. The computer system also includes an expression manager to respectively adjust one or more control parameters associated with each of the plurality of blendshapes for adjusting an expression of the animated character. The computer system also includes a corrective element manager that applies one or more corrective elements to the combined blendshapes based upon at least one of the control parameters. The one or more applied corrective elements are adjustable based upon one or more of the control parameters absent the introduction of one or more additional control parameters.

    摘要翻译: 系统包括能够表示一个或多个动画角色的计算机系统。 计算机系统包括一个混合形状管理器,它结合了多个混合形状以产生动画角色。 计算机系统还包括表达管理器,用于分别调整与多个混合形状中的每一个相关联的一个或多个控制参数,以调整动画角色的表达。 计算机系统还包括校正元件管理器,其基于至少一个控制参数将一个或多个校正元件应用于组合的混合形状。 基于一个或多个控制参数,一个或多个应用的​​校正元件是可调整的,而不引入一个或多个附加的控制参数。

    Simulation stream pipeline
    3.
    发明授权

    公开(公告)号:US10825225B1

    公开(公告)日:2020-11-03

    申请号:US16359732

    申请日:2019-03-20

    摘要: Some implementations of the disclosure are directed to a pipeline that enables real time engines such as gaming engines to leverage high quality simulations generated offline via film grade simulation systems. In one implementation, a method includes: obtaining simulation data and skeletal mesh data of a character, the simulation data and skeletal mesh data including the character in the same rest pose; importing the skeletal mesh data into a real-time rendering engine; and using at least the simulation data and the imported skeletal mesh data to derive from the simulation data a transformed simulation vertex cache that is usable by the real-time rendering engine during runtime to be skinned in place of the rest pose.

    DETERMINING CONTROL VALUES OF AN ANIMATION MODEL USING PERFORMANCE CAPTURE

    公开(公告)号:US20170148201A1

    公开(公告)日:2017-05-25

    申请号:US15424727

    申请日:2017-02-03

    IPC分类号: G06T13/40 G06K9/00 G06T7/73

    摘要: Performance capture systems and techniques are provided for capturing a performance of a subject and reproducing an animated performance that tracks the subject's performance. For example, systems and techniques are provided for determining control values for controlling an animation model to define features of a computer-generated representation of a subject based on the performance. A method may include obtaining input data corresponding to a pose performed by the subject, the input data including position information defining positions on a face of the subject. The method may further include obtaining an animation model for the subject that includes adjustable controls that control the animation model to define facial features of the computer-generated representation of the face, and matching one or more of the positions on the face with one or more corresponding positions on the animation model. The matching includes using an objective function to project an error onto a control space of the animation model. The method may further include determining, using the projected error and one or more constraints on the adjustable controls, one or more values for one or more of the adjustable controls. The values are configured to control the animation model to cause the computer-generated representation to perform a representation of the pose using the one or more adjustable controls.

    Combining shapes for animation
    5.
    发明授权
    Combining shapes for animation 有权
    组合动画形状

    公开(公告)号:US09183660B2

    公开(公告)日:2015-11-10

    申请号:US14090686

    申请日:2013-11-26

    摘要: A system includes a computing device that includes a memory for storing instructions. The computing device also includes a processor configured to execute the instructions to perform a method that includes combining, in a nonlinear manner, a first set of vertex displacements that represent the difference between a first animated expression and a neutral animated expression with a second set of vertex displacements that represent the difference between a second animated expression and the neutral animated expression. The number of vertices associated with the first set of vertex displacements of the first animated expression is equivalent to the number of vertices associated with the second set of vertex displacements of the second animated expression.

    摘要翻译: 一种系统包括计算装置,其包括用于存储指令的存储器。 计算设备还包括处理器,其被配置为执行指令以执行包括以非线性方式组合第一组顶点位移的方法,所述第一组顶点位移表示第一动画表达式和中性动画表达式之间的差异, 表示第二动画表达和中性动画表达之间差异的顶点位移。 与第一动画表达式的第一组顶点位移相关联的顶点的数量等于与第二动画表达式的第二组顶点位移相关联的顶点数。

    CONTROLLING ANIMATED CHARACTER EXPRESSION
    6.
    发明申请
    CONTROLLING ANIMATED CHARACTER EXPRESSION 审中-公开
    控制动画字符表达

    公开(公告)号:US20140192059A1

    公开(公告)日:2014-07-10

    申请号:US14139409

    申请日:2013-12-23

    IPC分类号: G06T11/60 G06T13/80

    CPC分类号: G06T11/60 G06T13/40 G06T13/80

    摘要: A system includes a computer system capable of representing one or more animated characters. The computer system includes a blendshape manager that combines multiple blendshapes to produce the animated character. The computer system also includes an expression manager to respectively adjust one or more control parameters associated with each of the plurality of blendshapes for adjusting an expression of the animated character. The computer system also includes a corrective element manager that applies one or more corrective elements to the combined blendshapes based upon at least one of the control parameters. The one or more applied corrective elements are adjustable based upon one or more of the control parameters absent the introduction of one or more additional control parameters.

    摘要翻译: 系统包括能够表示一个或多个动画角色的计算机系统。 计算机系统包括一个混合形状管理器,它结合了多个混合形状以产生动画角色。 计算机系统还包括表达管理器,用于分别调整与多个混合形状中的每一个相关联的一个或多个控制参数,以调整动画角色的表达。 计算机系统还包括校正元件管理器,其基于至少一个控制参数将一个或多个校正元件应用于组合的混合形状。 基于一个或多个控制参数,一个或多个应用的​​校正元件是可调整的,而不引入一个或多个附加的控制参数。

    Compositing images for augmented reality

    公开(公告)号:US10692288B1

    公开(公告)日:2020-06-23

    申请号:US15634843

    申请日:2017-06-27

    摘要: A method may include capturing a first image of a physical environment using a mobile device. The mobile device may include a physical camera and a display. The method may also include receiving a second image from a content provider system. The second image may be generated by the content provider system by rendering a view from a virtual camera in a virtual environment. The virtual environment may represent at least a portion of the physical environment. A location of the virtual camera in the virtual environment may correspond to a location of the physical camera in the physical environment. The second image may include a view of a computer-generated object. The method may additionally include generating a third image by compositing the first image and the second image, and causing the third image to be displayed on the display of the mobile device.

    Facial animation models
    9.
    发明授权

    公开(公告)号:US09747716B1

    公开(公告)日:2017-08-29

    申请号:US13839243

    申请日:2013-03-15

    IPC分类号: G06T17/00 G06T13/40

    摘要: A system includes a computing device that includes a memory configured to store instructions. The system also includes a processor configured to execute the instructions to perform a method that includes receiving multiple representations of an object. Each of the representations includes position information of the object and corresponds to an instance in time. For at least one of the representations, the method includes defining a contour that represents a movable silhouette of a surface feature of the object. The method also includes producing a deformable model of the surface of the object from the defined contour and from the at least one representation of the object.

    LIP SYNCHRONIZATION BETWEEN RIGS
    10.
    发明申请
    LIP SYNCHRONIZATION BETWEEN RIGS 审中-公开
    RIGS之间的LIP同步

    公开(公告)号:US20170053663A1

    公开(公告)日:2017-02-23

    申请号:US14831021

    申请日:2015-08-20

    IPC分类号: G10L21/10 G06T13/40 G06T13/20

    摘要: In some embodiments a method of transferring facial expressions from a subject to a computer-generated character is provided where the method includes receiving positional information from a motion capture session of the subject representing a performance having facial expressions to be transferred to the computer-generated character, receiving a first animation model that represents the subject, and receiving a second animation model that represents the computer-generated character. Each of the first and second animation models can include a plurality of adjustable controls that define geometries of the model and that can be adjusted to present different facial expressions on the model, and where the first and second animation models are designed so that setting the same values for the same set of adjustable controls in each model generates a similar facial poses on the models. The method further includes determining a solution, including values for at least some of the plurality of controls, that matches the first animation model to the positional information to reproduce the facial expressions from the performance to the first animation model, retargeting the facial expressions from the performance to the second animation model using the solution; and thereafter, synchronizing lip movement of the second animation model with lip movement from the first animation model.

    摘要翻译: 在一些实施例中,提供了将面部表情从受试者转移到计算机生成的角色的方法,其中所述方法包括从表示具有要传送到计算机生成的角色的表情的表现的对象的运动捕捉会话中接收位置信息 ,接收表示所述对象的第一动画模型,以及接收表示所述计算机生成的角色的第二动画模型。 第一和第二动画模型中的每一个可以包括多个可调整的控件,其限定模型的几何形状,并且可以被调整以在模型上呈现不同的面部表情,并且其中第一和第二动画模型被设计成使得设置相同 每个模型中同一组可调节控件的值在模型上产生类似的面部姿势。 该方法还包括确定包括与第一动画模型匹配的多个控件中的至少一些的值的解决方案与位置信息,以从表演到第一动画模型再现面部表情,将面部表情从 使用该解决方案对第二动画模型的性能; 之后,使第二动画模型的唇部移动与来自第一动画模型的唇部移动同步。