公开(公告)号：US08134555B2

公开(公告)日：2012-03-13

申请号：US12105141

申请日：2008-04-17

申请人： Paul E. Debevec ,  Wan-Chun Ma ,  Timothy Hawkins

发明人： Paul E. Debevec ,  Wan-Chun Ma ,  Timothy Hawkins

IPC分类号： G06T15/00

CPC分类号： G01B11/25

摘要： An apparatus for generating a surface normal map of an object may include a plurality of light sources having intensities that are controllable so as to generate one or more gradient illumination patterns. The light sources are configured and arranged to illuminate the surface of the object with the gradient illumination patterns. A camera may receive light reflected from the illuminated surface of the object, and generate data representative of the reflected light. A processing system may process the data so as to estimate the surface normal map of the surface of the object. A specular normal map and a diffuse normal map of the surface of the object may be generated separately, by placing polarizers on the light sources and in front of the camera so as to illuminate the surface of the object with polarized spherical gradient illumination patterns.

摘要翻译： 用于产生物体的表面法线图的装置可以包括具有可控制的强度的多个光源，以便生成一个或多个梯度照明图案。 光源被配置和布置成用梯度照明图案来照亮物体的表面。 相机可以接收从物体的照射表面反射的光，并产生表示反射光的数据。 处理系统可以处理数据以估计对象表面的表面法线贴图。 物体表面的镜面法线贴图和漫反射法线图可以单独生成，方法是将偏振器放置在光源上并在相机前方，以偏光球形渐变照明图案照射物体表面。

公开(公告)号：US08902232B2

公开(公告)日：2014-12-02

申请号：US12364284

申请日：2009-02-02

申请人： Paul E. Debevec ,  Wan-Chun Ma ,  Timothy Hawkins

发明人： Paul E. Debevec ,  Wan-Chun Ma ,  Timothy Hawkins

IPC分类号： G06T15/00 ,  G06T13/40

CPC分类号： G06T13/40 ,  G06T2207/30196

摘要： Acquisition, modeling, compression, and synthesis of realistic facial deformations using polynomial displacement maps are described. An analysis phase can be included where the relationship between motion capture markers and detailed facial geometry is inferred. A synthesis phase can be included where detailed animated facial geometry is driven by a sparse set of motion capture markers. For analysis, an actor can be recorded wearing facial markers while performing a set of training expression clips. Real-time high-resolution facial deformations are captured, including dynamic wrinkle and pore detail, using interleaved structured light 3D scanning and photometric stereo. Next, displacements are calculated between a neutral mesh driven by the motion capture markers and the high-resolution captured expressions. These geometric displacements are stored in one or more polynomial displacement maps parameterized according to the local deformations of the motion capture dots. For synthesis, the polynomial displacement maps can be driven with new motion capture data.

摘要翻译： 描述使用多项式位移图的采集，建模，压缩和逼真的面部变形的综合。 可以包括分析阶段，其中推断运动捕捉标记和详细面部几何之间的关系。 可以包括合成阶段，其中详细的动画面部几何由稀疏的运动捕捉标记组驱动。 为了分析，可以在执行一组训练表情剪辑时，记录佩戴面部标记的演员。 捕获实时高分辨率面部变形，包括动态皱纹和细孔细节，使用交错结构光3D扫描和光度立体声。 接下来，在由运动捕捉标记驱动的中性网格和高分辨率捕获表达式之间计算位移。 这些几何位移存储在根据运动捕获点的局部变形参数化的一个或多个多项式位移图中。 为了合成，多项式位移图可以用新的运动捕捉数据驱动。

公开(公告)号：US20090195545A1

公开(公告)日：2009-08-06

申请号：US12364284

申请日：2009-02-02

申请人： Paul E. Debevec ,  Wan-Chun Ma ,  Timothy Hawkins

发明人： Paul E. Debevec ,  Wan-Chun Ma ,  Timothy Hawkins

IPC分类号： G06T15/70

CPC分类号： G06T13/40 ,  G06T2207/30196

摘要： Acquisition, modeling, compression, and synthesis of realistic facial deformations using polynomial displacement maps are described. An analysis phase can be included where the relationship between motion capture markers and detailed facial geometry is inferred. A synthesis phase can be included where detailed animated facial geometry is driven by a sparse set of motion capture markers. For analysis, an actor can be recorded wearing facial markers while performing a set of training expression clips. Real-time high-resolution facial deformations are captured, including dynamic wrinkle and pore detail, using interleaved structured light 3D scanning and photometric stereo. Next, displacements are calculated between a neutral mesh driven by the motion capture markers and the high-resolution captured expressions. These geometric displacements are stored in one or more polynomial displacement maps parameterized according to the local deformations of the motion capture dots. For synthesis, the polynomial displacement maps can be driven with new motion capture data.

摘要翻译： 描述使用多项式位移图的采集，建模，压缩和逼真的面部变形的综合。 可以包括分析阶段，其中推断运动捕捉标记和详细面部几何之间的关系。 可以包括合成阶段，其中详细的动画面部几何由稀疏的运动捕捉标记组驱动。 为了分析，可以在执行一组训练表情剪辑时，记录佩戴面部标记的演员。 捕获实时高分辨率面部变形，包括动态皱纹和细孔细节，使用交错结构光3D扫描和光度立体声。 接下来，在由运动捕捉标记驱动的中性网格和高分辨率捕获表达式之间计算位移。 这些几何位移存储在根据运动捕获点的局部变形参数化的一个或多个多项式位移图中。 为了合成，多项式位移图可以用新的运动捕捉数据驱动。

公开(公告)号：US20080304081A1

公开(公告)日：2008-12-11

申请号：US12105141

申请日：2008-04-17

申请人： Paul E. Debevec ,  Wan-Chun Ma ,  Timothy Hawkins

发明人： Paul E. Debevec ,  Wan-Chun Ma ,  Timothy Hawkins

IPC分类号： G01B11/24

CPC分类号： G01B11/25

摘要： An apparatus for generating a surface normal map of an object may include a plurality of light sources having intensities that are controllable so as to generate one or more gradient illumination patterns. The light sources are configured and arranged to illuminate the surface of the object with the gradient illumination patterns. A camera may receive light reflected from the illuminated surface of the object, and generate data representative of the reflected light. A processing system may process the data so as to estimate the surface normal map of the surface of the object. A specular normal map and a diffuse normal map of the surface of the object may be generated separately, by placing polarizers on the light sources and in front of the camera so as to illuminate the surface of the object with polarized spherical gradient illumination patterns.

摘要翻译： 用于产生物体的表面法线图的装置可以包括具有可控制的强度的多个光源，以便生成一个或多个梯度照明图案。 光源被配置和布置成用梯度照明图案来照亮物体的表面。 相机可以接收从物体的被照射表面反射的光，并产生表示反射光的数据。 处理系统可以处理数据以估计对象表面的表面法线贴图。 物体表面的镜面法线贴图和漫反射法线图可以单独生成，方法是将偏振器放置在光源上并在相机前方，以偏光球形渐变照明图案照射物体表面。