-
公开(公告)号:US10964083B1
公开(公告)日:2021-03-30
申请号:US16380653
申请日:2019-04-10
发明人: Kiran S. Bhat , Michael Koperwas , Rachel M. Rose , Jung-Seung Hong , Frederic P. Pighin , Christopher David Twigg , Cary Phillips , Steve Sullivan
IPC分类号: G06T13/40
摘要: A system includes a computing device that includes a memory configured to store instructions. The system also includes a processor configured to execute the instructions to perform a method that includes receiving multiple representations of one or more expressions of an object. Each of the representations includes position information attained from one or more images of the object. The method also includes producing an animation model from one or more groups of controls that respectively define each of the one or more expressions of the object as provided by the multiple representations. Each control of each group of controls has an adjustable value that defines the geometry of at least one shape of a portion of the respective expression of the object. Producing the animation model includes producing one or more corrective shapes if the animation model is incapable of accurately presenting the one or more expressions of the object as provided by the multiple representations.
-
公开(公告)号:US09256973B2
公开(公告)日:2016-02-09
申请号:US14139409
申请日:2013-12-23
摘要: A system includes a computer system capable of representing one or more animated characters. The computer system includes a blendshape manager that combines multiple blendshapes to produce the animated character. The computer system also includes an expression manager to respectively adjust one or more control parameters associated with each of the plurality of blendshapes for adjusting an expression of the animated character. The computer system also includes a corrective element manager that applies one or more corrective elements to the combined blendshapes based upon at least one of the control parameters. The one or more applied corrective elements are adjustable based upon one or more of the control parameters absent the introduction of one or more additional control parameters.
摘要翻译: 系统包括能够表示一个或多个动画角色的计算机系统。 计算机系统包括一个混合形状管理器,它结合了多个混合形状以产生动画角色。 计算机系统还包括表达管理器,用于分别调整与多个混合形状中的每一个相关联的一个或多个控制参数,以调整动画角色的表达。 计算机系统还包括校正元件管理器,其基于至少一个控制参数将一个或多个校正元件应用于组合的混合形状。 基于一个或多个控制参数,一个或多个应用的校正元件是可调整的,而不引入一个或多个附加的控制参数。
-
公开(公告)号:US10825225B1
公开(公告)日:2020-11-03
申请号:US16359732
申请日:2019-03-20
发明人: Ronald Radeztsky , Michael Koperwas
摘要: Some implementations of the disclosure are directed to a pipeline that enables real time engines such as gaming engines to leverage high quality simulations generated offline via film grade simulation systems. In one implementation, a method includes: obtaining simulation data and skeletal mesh data of a character, the simulation data and skeletal mesh data including the character in the same rest pose; importing the skeletal mesh data into a real-time rendering engine; and using at least the simulation data and the imported skeletal mesh data to derive from the simulation data a transformed simulation vertex cache that is usable by the real-time rendering engine during runtime to be skinned in place of the rest pose.
-
公开(公告)号:US20170148201A1
公开(公告)日:2017-05-25
申请号:US15424727
申请日:2017-02-03
发明人: Kiran Bhat , Michael Koperwas , Jeffery Yost , Ji Hun Yu , Sheila Santos
CPC分类号: G06T13/40 , G06K9/00315 , G06K9/6201 , G06T7/60 , G06T7/75 , G06T13/80 , G06T2207/10016 , G06T2207/30201
摘要: Performance capture systems and techniques are provided for capturing a performance of a subject and reproducing an animated performance that tracks the subject's performance. For example, systems and techniques are provided for determining control values for controlling an animation model to define features of a computer-generated representation of a subject based on the performance. A method may include obtaining input data corresponding to a pose performed by the subject, the input data including position information defining positions on a face of the subject. The method may further include obtaining an animation model for the subject that includes adjustable controls that control the animation model to define facial features of the computer-generated representation of the face, and matching one or more of the positions on the face with one or more corresponding positions on the animation model. The matching includes using an objective function to project an error onto a control space of the animation model. The method may further include determining, using the projected error and one or more constraints on the adjustable controls, one or more values for one or more of the adjustable controls. The values are configured to control the animation model to cause the computer-generated representation to perform a representation of the pose using the one or more adjustable controls.
-
公开(公告)号:US09183660B2
公开(公告)日:2015-11-10
申请号:US14090686
申请日:2013-11-26
CPC分类号: G06T13/40 , G06K9/6255 , G06T13/20 , G06T19/20 , G06T2219/2021
摘要: A system includes a computing device that includes a memory for storing instructions. The computing device also includes a processor configured to execute the instructions to perform a method that includes combining, in a nonlinear manner, a first set of vertex displacements that represent the difference between a first animated expression and a neutral animated expression with a second set of vertex displacements that represent the difference between a second animated expression and the neutral animated expression. The number of vertices associated with the first set of vertex displacements of the first animated expression is equivalent to the number of vertices associated with the second set of vertex displacements of the second animated expression.
摘要翻译: 一种系统包括计算装置,其包括用于存储指令的存储器。 计算设备还包括处理器,其被配置为执行指令以执行包括以非线性方式组合第一组顶点位移的方法,所述第一组顶点位移表示第一动画表达式和中性动画表达式之间的差异, 表示第二动画表达和中性动画表达之间差异的顶点位移。 与第一动画表达式的第一组顶点位移相关联的顶点的数量等于与第二动画表达式的第二组顶点位移相关联的顶点数。
-
公开(公告)号:US20140192059A1
公开(公告)日:2014-07-10
申请号:US14139409
申请日:2013-12-23
摘要: A system includes a computer system capable of representing one or more animated characters. The computer system includes a blendshape manager that combines multiple blendshapes to produce the animated character. The computer system also includes an expression manager to respectively adjust one or more control parameters associated with each of the plurality of blendshapes for adjusting an expression of the animated character. The computer system also includes a corrective element manager that applies one or more corrective elements to the combined blendshapes based upon at least one of the control parameters. The one or more applied corrective elements are adjustable based upon one or more of the control parameters absent the introduction of one or more additional control parameters.
摘要翻译: 系统包括能够表示一个或多个动画角色的计算机系统。 计算机系统包括一个混合形状管理器,它结合了多个混合形状以产生动画角色。 计算机系统还包括表达管理器,用于分别调整与多个混合形状中的每一个相关联的一个或多个控制参数,以调整动画角色的表达。 计算机系统还包括校正元件管理器,其基于至少一个控制参数将一个或多个校正元件应用于组合的混合形状。 基于一个或多个控制参数,一个或多个应用的校正元件是可调整的,而不引入一个或多个附加的控制参数。
-
公开(公告)号:US10692288B1
公开(公告)日:2020-06-23
申请号:US15634843
申请日:2017-06-27
摘要: A method may include capturing a first image of a physical environment using a mobile device. The mobile device may include a physical camera and a display. The method may also include receiving a second image from a content provider system. The second image may be generated by the content provider system by rendering a view from a virtual camera in a virtual environment. The virtual environment may represent at least a portion of the physical environment. A location of the virtual camera in the virtual environment may correspond to a location of the physical camera in the physical environment. The second image may include a view of a computer-generated object. The method may additionally include generating a third image by compositing the first image and the second image, and causing the third image to be displayed on the display of the mobile device.
-
公开(公告)号:US10484824B1
公开(公告)日:2019-11-19
申请号:US15194094
申请日:2016-06-27
发明人: John Gaeta , Michael Koperwas , Nicholas Rasmussen
IPC分类号: G06T19/00 , G06T3/00 , H04W4/02 , H04B1/3827 , H04M1/725
摘要: A method may include causing first content to be displayed on a display device. The method may also include determining a location of a mobile device relative to the display device. In some embodiments, the mobile device may be positioned such that the first content is visible to a viewer of the mobile device. The method may additionally include causing second content to be displayed on the mobile device such that the second content is layered over the first content.
-
公开(公告)号:US09747716B1
公开(公告)日:2017-08-29
申请号:US13839243
申请日:2013-03-15
CPC分类号: G06T13/40 , G06T19/20 , G06T2219/2021
摘要: A system includes a computing device that includes a memory configured to store instructions. The system also includes a processor configured to execute the instructions to perform a method that includes receiving multiple representations of an object. Each of the representations includes position information of the object and corresponds to an instance in time. For at least one of the representations, the method includes defining a contour that represents a movable silhouette of a surface feature of the object. The method also includes producing a deformable model of the surface of the object from the defined contour and from the at least one representation of the object.
-
公开(公告)号:US20170053663A1
公开(公告)日:2017-02-23
申请号:US14831021
申请日:2015-08-20
CPC分类号: G06T13/40 , G06K9/00302 , G06K9/4604 , G06T7/246 , G06T2207/30201 , G06T2207/30204
摘要: In some embodiments a method of transferring facial expressions from a subject to a computer-generated character is provided where the method includes receiving positional information from a motion capture session of the subject representing a performance having facial expressions to be transferred to the computer-generated character, receiving a first animation model that represents the subject, and receiving a second animation model that represents the computer-generated character. Each of the first and second animation models can include a plurality of adjustable controls that define geometries of the model and that can be adjusted to present different facial expressions on the model, and where the first and second animation models are designed so that setting the same values for the same set of adjustable controls in each model generates a similar facial poses on the models. The method further includes determining a solution, including values for at least some of the plurality of controls, that matches the first animation model to the positional information to reproduce the facial expressions from the performance to the first animation model, retargeting the facial expressions from the performance to the second animation model using the solution; and thereafter, synchronizing lip movement of the second animation model with lip movement from the first animation model.
摘要翻译: 在一些实施例中,提供了将面部表情从受试者转移到计算机生成的角色的方法,其中所述方法包括从表示具有要传送到计算机生成的角色的表情的表现的对象的运动捕捉会话中接收位置信息 ,接收表示所述对象的第一动画模型,以及接收表示所述计算机生成的角色的第二动画模型。 第一和第二动画模型中的每一个可以包括多个可调整的控件,其限定模型的几何形状,并且可以被调整以在模型上呈现不同的面部表情,并且其中第一和第二动画模型被设计成使得设置相同 每个模型中同一组可调节控件的值在模型上产生类似的面部姿势。 该方法还包括确定包括与第一动画模型匹配的多个控件中的至少一些的值的解决方案与位置信息,以从表演到第一动画模型再现面部表情,将面部表情从 使用该解决方案对第二动画模型的性能; 之后,使第二动画模型的唇部移动与来自第一动画模型的唇部移动同步。
-
-
-
-
-
-
-
-
-