公开(公告)号：WO2016070354A1

公开(公告)日：2016-05-12

申请号：PCT/CN2014/090327

申请日：2014-11-05

Applicant: INTEL CORPORATION ,  DU, Yangzhou ,  LI, Wenlong ,  LI, Qiang ,  TONG, Xiaofeng ,  KIM, Tae-Hoon ,  PARK, Minje

Inventor： DU, Yangzhou ,  LI, Wenlong ,  LI, Qiang ,  TONG, Xiaofeng ,  KIM, Tae-Hoon ,  PARK, Minje

IPC: G06T13/40

CPC classification number: G06T13/40 ,  G06F17/2785 ,  G06K9/00248 ,  G06K9/00281 ,  G06K9/00308 ,  G06T13/205 ,  G10L25/48

Abstract: Apparatuses, methods and storage medium associated with creating an avatar video are disclosed herein. In embodiments, the apparatus may one or more facial expression engines, an animation-rendering engine, and a video generator. The one or more facial expression engines may be configured to receive video, voice and/or text inputs, and, in response, generate a plurality of animation messages having facial expression parameters that depict facial expressions for a plurality of avatars based at least in part on the video, voice and/or text inputs received. The animation-rendering engine may be configured to receive the one or more animation messages, and drive a plurality of avatar models, to animate and render the plurality of avatars with the facial expression depicted. The video generator may be configured to capture the animation and rendering of the plurality of avatars, to generate a video. Other embodiments may be described and/or claimed.

Abstract translation: 本文公开了与创建头像视频相关联的装置，方法和存储介质。 在实施例中，该装置可以是一个或多个面部表情引擎，动画呈现引擎和视频生成器。 一个或多个面部表情引擎可以被配置为接收视频，语音和/或文本输入，并且作为响应，至少部分地生成具有描绘多个化身的面部表情的面部表情参数的多个动画消息 接收的视频，语音和/或文本输入。 动画呈现引擎可以被配置为接收一个或多个动画消息，并且驱动多个化身模型，用所描绘的面部表情来动画化和呈现多个化身。 视频发生器可以被配置为捕获多个化身的动画和渲染，以生成视频。 可以描述和/或要求保护其他实施例。

公开(公告)号：WO2017101094A1

公开(公告)日：2017-06-22

申请号：PCT/CN2015/097826

申请日：2015-12-18

Applicant: INTEL CORPORATION ,  PARK, Minje ,  KIM, Tae-Hoon ,  JU, Myung-Ho ,  YI, Jihyeon ,  SHEN, Xiaolu ,  ZHANG, Lidan ,  LI, Qiang

Inventor： PARK, Minje ,  KIM, Tae-Hoon ,  JU, Myung-Ho ,  YI, Jihyeon ,  SHEN, Xiaolu ,  ZHANG, Lidan ,  LI, Qiang

IPC: G06T13/40

CPC classification number: G06T13/40 ,  G06T7/73 ,  G06T17/20 ,  G06T2207/20084 ,  G06T2207/30201 ,  G06T2210/44

Abstract: Avatar animation systems disclosed herein provide high quality, real-time avatar animation that is based on the varying countenance of a human face. The real-time provision of high quality avatar animation is enabled, at least in part, by a multi-frame regressor that is configured to map information descriptive of facial expressions depicted in two or more images to information descriptive of a single avatar blend shape. The two or more images may be temporally sequential images. This multi-frame regressor implements a machine learning component that generates the high quality avatar animation from information descriptive of a subject's face and/or information descriptive of avatar animation frames previously generated by the multi-frame regressor. The machine learning component may be trained using a set of training images that depict human facial expressions and avatar animation authored by professional animators to reflect facial expressions depicted in the set of training images.

Abstract translation: 这里公开的头像动画系统提供基于人脸的变化的人脸的高质量实时头像动画。 高质量化身动画的实时提供至少部分地由多帧回归器实现，该多帧回归器配置成将描述两幅或多幅图像中描绘的面部表情的信息映射到描述单个化身混合形状的信息。 该两个或更多个图像可以是时间上连续的图像。 该多帧回归器实现机器学习组件，其从描述主体的脸部的信息和/或描述先前由多帧回归器生成的化身动画帧的信息来生成高质量化身动画。 机器学习组件可以使用一组描述人类面部表情的训练图像和由专业动画师创作的化身动画来反映在该组训练图像中描绘的面部表情。

公开(公告)号：WO2016045050A1

公开(公告)日：2016-03-31

申请号：PCT/CN2014/087426

申请日：2014-09-25

Applicant: INTEL CORPORATION ,  SHEN, Xiaolu ,  DU, Yangzhou ,  PARK, Minje ,  CHEON, Yeongjae ,  DUCHENNE, Olivier ,  KIM, Tae- Hoon

Inventor： SHEN, Xiaolu ,  DU, Yangzhou ,  PARK, Minje ,  CHEON, Yeongjae ,  DUCHENNE, Olivier ,  KIM, Tae- Hoon

IPC: G06T7/20

CPC classification number: G06K9/00248 ,  G06F3/012 ,  G06F3/017 ,  G06T1/0007 ,  G06T7/246 ,  G06T7/97 ,  G06T2201/00 ,  G06T2207/10016 ,  G06T2207/30201

Abstract: A mechanism is described for facilitating efficient free in-plane rotation landmark tracking of images on computing devices according to one embodiment. A method of embodiments, as described herein, includes detecting a first frame having a first image and a second frame having a second image, where the second image is rotated to a position away from the first image. The method may further include assigning a first parameter line and a second parameter line to the second image based on landmark positions associated with the first and second images, detecting a rotation angle between the first parameter line and the second parameter line, and rotating the second image back and forth within a distance associated with the rotation angle to verify positions of the first and second images.

Abstract translation: 描述了根据一个实施例的用于促进计算设备上的图像的有效的自由面内旋转地标跟踪的机构。 如本文所述的实施例的方法包括检测具有第一图像的第一帧和具有第二图像的第二帧，其中第二图像旋转到远离第一图像的位置。 该方法还可以包括基于与第一和第二图像相关联的界标位置向第二图像分配第一参数线和第二参数线，检测第一参数线和第二参数线之间的旋转角度，以及旋转第二参数线 在与旋转角度相关联的距离内来回显示图像，以验证第一和第二图像的位置。

公开(公告)号：WO2016101131A1

公开(公告)日：2016-06-30

申请号：PCT/CN2014/094618

申请日：2014-12-23

Applicant: INTEL CORPORATION ,  FANG, Yikai ,  DU, Yangzhou ,  LI, Qiang, Eric ,  TONG, Xiaofeng ,  LI, Wenlong ,  PARK, Minje ,  JU, Myung-Ho ,  YI, Jihyeon Kate ,  KIM, Tae-Hoon Pete

Inventor： FANG, Yikai ,  DU, Yangzhou ,  LI, Qiang, Eric ,  TONG, Xiaofeng ,  LI, Wenlong ,  PARK, Minje ,  JU, Myung-Ho ,  YI, Jihyeon Kate ,  KIM, Tae-Hoon Pete

IPC: G06T13/40

CPC classification number: G06T13/40 ,  G06K9/00255 ,  G06K9/00315 ,  G06K9/00355 ,  G06T5/002 ,  G06T2207/10016 ,  G06T2207/20092 ,  G06T2207/20182 ,  G06T2207/30201

Abstract: Examples of systems and methods for augmented facial animation are generally described herein. A method for mapping facial expressions to an alternative avatar expression may include capturing a series of images of a face, and detecting a sequence of facial expressions of the face from the series of images. The method may include determining an alternative avatar expression mapped to the sequence of facial expressions, and animating an avatar using the alternative avatar expression.

Abstract translation: 这里通常描述用于增强面部动画的系统和方法的示例。 用于将面部表情映射到替代化身表情的方法可以包括捕获脸部的一系列图像，以及从该系列图像中检测面部的面部表情的序列。 该方法可以包括确定映射到面部表情序列的替代化身表达，以及使用替代化身表达来动画化身化身。

公开(公告)号：WO2015192369A1

公开(公告)日：2015-12-23

申请号：PCT/CN2014/080382

申请日：2014-06-20

Applicant: INTEL CORPORATION ,  PARK, Minje ,  DUCHENNE, Olivier ,  CHEON, Yeongjae ,  KIM, Tae-Hoon ,  SHEN, Xiaolu ,  DU, Yangzhou ,  RYU, Wooju ,  JU, Myung-Ho

Inventor： PARK, Minje ,  DUCHENNE, Olivier ,  CHEON, Yeongjae ,  KIM, Tae-Hoon ,  SHEN, Xiaolu ,  DU, Yangzhou ,  RYU, Wooju ,  JU, Myung-Ho

IPC: G06T15/08

CPC classification number: G06T17/205 ,  G06K9/00208 ,  G06K9/00214 ,  G06K9/00221 ,  G06K9/00248 ,  G06K9/00261 ,  G06K9/00281 ,  G06T7/251 ,  G06T17/20 ,  G06T2200/04 ,  G06T2207/30201

Abstract: Apparatuses, methods and storage medium associated with 3D face model reconstruction are disclosed herein. In embodiments, an apparatus may include a facial landmark detector, a model fitter and a model tracker. The facial landmark detector may be configured to detect a plurality of landmarks of a face and their locations within each of a plurality of image frames. The model fitter may be configured to generate a 3D model of the face from a 3D model of a neutral face, in view of detected landmarks of the face and their locations within a first one of the plurality of image frames. The model tracker may be configured to maintain the 3D model to track the face in subsequent image frames, successively updating the 3D model in view of detected landmarks of the face and their locations within each of successive ones of the plurality of image frames. In embodiments, the facial landmark detector may include a face detector, an initial facial landmark detector, and one or more facial landmark detection linear regressors. Other embodiments may be described and/or claimed.

Abstract translation: 本文公开了与3D脸部模型重建相关联的装置，方法和存储介质。 在实施例中，装置可以包括面部地标检测器，模型装配器和模型跟踪器。 面部地标检测器可以被配置为检测面部的多个界标及其在多个图像帧的每一个内的位置。 考虑到检测到的面部的标记及其在多个图像帧的第一个图像帧中的位置，模型拟合器可以被配置为从中立面的3D模型生成面部的3D模型。 模型跟踪器可以被配置为维持3D模型以跟踪后续图像帧中的面部，从而考虑到检测到的面部的界标及其在多个图像帧中的每个连续图像帧中的位置之间的连续更新3D模型。 在实施例中，面部地标检测器可以包括面部检测器，初始面部地标检测器和一个或多个面部地标检测线性回归器。 可以描述和/或要求保护其他实施例。

公开(公告)号：WO2015139231A1

公开(公告)日：2015-09-24

申请号：PCT/CN2014/073695

申请日：2014-03-19

Applicant: INTEL CORPORATION ,  DU, Yangzhou ,  KIM, Tae-Hoon ,  LI, Wenlong ,  LI, Qiang ,  TONG, Xiaofeng ,  WANG, Tao ,  PARK, Minje ,  DUCHENNE, Olivier ,  ZHANG, Yimin ,  CHEON, Yeongjae ,  JUN, Bongjin ,  RYU, Wooju ,  SACHSON, Thomas ,  SMILEY, Mary D.

Inventor： DU, Yangzhou ,  KIM, Tae-Hoon ,  LI, Wenlong ,  LI, Qiang ,  TONG, Xiaofeng ,  WANG, Tao ,  PARK, Minje ,  DUCHENNE, Olivier ,  ZHANG, Yimin ,  CHEON, Yeongjae ,  JUN, Bongjin ,  RYU, Wooju ,  SACHSON, Thomas ,  SMILEY, Mary D.

IPC: G06T13/40

CPC classification number: G06T13/40 ,  G06K9/00308 ,  G06K9/00315 ,  G06K9/00335 ,  G06K2009/4666 ,  G06T7/251 ,  G06T15/005 ,  G06T2200/04 ,  G06T2207/10016 ,  G06T2207/30201

Abstract: Apparatuses, methods and storage medium associated with animating and rendering an avatar are disclosed herein. In embodiments, an apparatus may include a facial mesh tracker to receive a plurality of image frames, detect facial action movements of a face and head pose gestures of a head within the plurality of image frames, and output a plurality of facial motion parameters and head pose parameters that depict facial action movements and head pose gestures detected, all in real time, for animation and rendering of an avatar. The facial action movements and head pose gestures may be detected through inter-frame differences for a mouth and an eye, or the head, based on pixel sampling of the image frames. The facial action movements may include opening or closing of a mouth, and blinking of an eye. The head pose gestures may include head rotation such as pitch, yaw, roll, and head movement along horizontal and vertical direction, and the head comes closer or goes farther from the camera. Other embodiments may be described and/or claimed.

Abstract translation: 本文公开了与动画和呈现化身相关联的装置，方法和存储介质。 在实施例中，装置可以包括面部网格跟踪器，用于接收多个图像帧，检测多个图像帧内的头部的脸部和头部姿势手势的面部动作运动，并且输出多个面部运动参数和头部 构成参数，其描绘了所有实时检测到的面部动作动作和头部姿势手势，用于动画和呈现头像。 基于图像帧的像素采样，可以通过口和眼或头部的帧间差异来检测面部动作运动和头部姿势手势。 面部动作动作可以包括开口或闭合嘴，以及眼睛的眨眼。 头部姿势手势可以包括水平和垂直方向的头部旋转，例如俯仰，偏航，滚动和头部移动，并且头部靠近或离开相机更远。 可以描述和/或要求保护其他实施例。