公开(公告)号：US20160275721A1

公开(公告)日：2016-09-22

申请号：US14443337

申请日：2014-06-20

申请人： Minje PARK ,  Olivier DUCHENNE ,  Yeongjae CHEON ,  Tae- Hoon KIM ,  Xiaolu SHEN ,  Yangzhou DU ,  Wooju RYU ,  Myung-He JU ,  INTEL CORPORATION

发明人： Minje PARK ,  Olivier DUCHENNE ,  Yeongjae CHEON ,  Tae-Hoon KIM ,  Xiaolu SHEN ,  Yangzhou DU ,  Wooju RYU ,  Myung-Ho JU

IPC分类号： G06T17/20 ,  G06K9/00

CPC分类号： G06T17/205 ,  G06K9/00208 ,  G06K9/00214 ,  G06K9/00221 ,  G06K9/00248 ,  G06K9/00261 ,  G06K9/00281 ,  G06T7/251 ,  G06T17/20 ,  G06T2200/04 ,  G06T2207/30201

摘要： Apparatuses, methods and storage medium associated with 3D face model reconstruction are disclosed herein. In embodiments, an apparatus may include a facial landmark detector, a model fitter and a model tracker. The facial landmark detector may be configured to detect a plurality of landmarks of a face and their locations within each of a plurality of image frames. The model fitter may be configured to generate a 3D model of the face from a 3D model of a neutral face, in view of detected landmarks of the face and their locations within a first one of the plurality of image frames. The model tracker may be configured to maintain the 3D model to track the face in subsequent image frames, successively updating the 3D model in view of detected landmarks of the face and their locations within each of successive ones of the plurality of image frames. In embodiments, the facial landmark detector may include a face detector, an initial facial landmark detector, and one or more facial landmark detection linear regressors. Other embodiments may be described and/or claimed.

摘要翻译： 本文公开了与3D脸部模型重建相关联的装置，方法和存储介质。 在实施例中，装置可以包括面部地标检测器，模型装配器和模型跟踪器。 面部地标检测器可以被配置为检测面部的多个界标及其在多个图像帧的每一个内的位置。 考虑到检测到的面部的标记及其在多个图像帧的第一个图像帧中的位置，模型拟合器可以被配置为从中立面的3D模型生成面部的3D模型。 模型跟踪器可以被配置为维持3D模型以跟踪后续图像帧中的面部，从而考虑到检测到的面部的界标及其在多个图像帧中的每个连续图像帧中的位置之间的连续更新3D模型。 在实施例中，面部地标检测器可以包括面部检测器，初始面部地标检测器和一个或多个面部地标检测线性回归器。 可以描述和/或要求保护其他实施例。

公开(公告)号：US20160042548A1

公开(公告)日：2016-02-11

申请号：US14416580

申请日：2014-03-19

申请人： INTEL CORPORATION

发明人： Yangzhou DU ,  Tae-Hoon KIM ,  Wenlong LI ,  Qiang LI ,  Xiaofeng TONG ,  Tao WANG ,  Minje PARK ,  Olivier DUCHENNE ,  Yimin ZHANG ,  Yeongjae CHEON ,  Bongjin JUN ,  Wooju RYU ,  Thomas SACHSON ,  Mary D. SMILEY

IPC分类号： G06T13/40 ,  G06T7/20 ,  G06T15/00 ,  G06K9/00

CPC分类号： G06T13/40 ,  G06K9/00308 ,  G06K9/00315 ,  G06K9/00335 ,  G06K2009/4666 ,  G06T7/251 ,  G06T15/005 ,  G06T2200/04 ,  G06T2207/10016 ,  G06T2207/30201

摘要： Apparatuses, methods and storage medium associated with animating and rendering an avatar are disclosed herein. In embodiments, an apparatus may include a facial mesh tracker to receive a plurality of image frames, detect facial action movements of a face and head pose gestures of a head within the plurality of image frames, and output a plurality of facial motion parameters and head pose parameters that depict facial action movements and head pose gestures detected, all in real time, for animation and rendering of an avatar. The facial action movements and head pose gestures may be detected through inter-frame differences for a mouth and an eye, or the head, based on pixel sampling of the image frames. The facial action movements may include opening or closing of a mouth, and blinking of an eye. The head pose gestures may include head rotation such as pitch, yaw, roll, and head movement along horizontal and vertical direction, and the head comes closer or goes farther from the camera. Other embodiments may be described and/or claimed.

摘要翻译： 本文公开了与动画和呈现化身相关联的装置，方法和存储介质。 在实施例中，装置可以包括面部网格跟踪器，用于接收多个图像帧，检测多个图像帧内的头部的脸部和头部姿势手势的面部动作运动，并且输出多个面部运动参数和头部 构成参数，其描绘了所有实时检测到的面部动作动作和头部姿势手势，用于动画和呈现头像。 基于图像帧的像素采样，可以通过口和眼或头部的帧间差异来检测面部动作运动和头部姿势手势。 面部动作动作可以包括开口或闭合嘴，以及眼睛的眨眼。 头部姿势手势可以包括水平和垂直方向的头部旋转，例如俯仰，偏航，滚动和头部移动，并且头部靠近或离开相机更远。 可以描述和/或要求保护其他实施例。