Skin reflectance model for representing and rendering faces
    1.
    发明授权
    Skin reflectance model for representing and rendering faces 失效
    用于表示和渲染面部的皮肤反射率模型

    公开(公告)号:US07319467B2

    公开(公告)日:2008-01-15

    申请号:US11092426

    申请日:2005-03-29

    IPC分类号: G06T15/50

    CPC分类号: G06T15/50

    摘要: A face is scanned to obtain a three-dimensional geometry of the face, images are also acquired of the face, and subsurface scattering of the face is measured. A translucency map is determined from the subsurface reflectance. A total surface reflectance and a normal map are estimated from the three-dimensional geometry and the images, and diffuse reflectance is estimated using the total reflectance. An albedo map is determined from the diffuse reflectance. The diffuse reflectance is subtracted from the total reflectance to obtain a surface reflectance. A set of bi-directional reflectance functions is fitted to the surface reflectance. Then, the set of bi-directional reflectance distribution functions, the albedo map, and the translucency map are combined to form a skin reflectance model of the face.

    摘要翻译: 扫描面部以获得脸部的三维几何图像,并且还获取脸部的图像,并且测量脸部的表面下散射。 从地下反射率确定半透明度图。 从三维几何图像和图像估计总表面反射率和法线图,并且使用总反射率来估计漫反射。 从漫反射率确定反照率图。 从总反射率中减去漫反射,得到表面反射率。 一组双向反射函数适合表面反射率。 然后,将该组双向反射分布函数,反照率图和半透明度图组合,以形成面部的皮肤反射率模型。

    Rendering deformable and animated surface reflectance fields
    2.
    发明申请
    Rendering deformable and animated surface reflectance fields 失效
    渲染可变形和动画表面反射场

    公开(公告)号:US20060028474A1

    公开(公告)日:2006-02-09

    申请号:US10912724

    申请日:2004-08-05

    IPC分类号: G06T15/70 G06T13/00

    CPC分类号: G06T13/20 G06T15/50

    摘要: A method renders a model of an object by first acquiring, in an acquisition space, a reflectance field of the object. The reflectance field includes a set of reflectance images of the object and a point model of the object. The model is deformed in an object space to generate a deformed model. For each point of the deformed model in the object space, the set of the reflectance images is queried in the acquisition space to obtain reflectance coefficients for each point. Each point of the deformed model is then shaded according to the corresponding reflectance coefficients to generate an image of the object reflecting the deforming.

    摘要翻译: 一种方法通过首先在采集空间中获取对象的反射场,从而呈现对象的模型。 反射场包括物体的一组反射图像和物体的点模型。 模型在对象空间中变形以生成变形模型。 对于对象空间中变形模型的每个点,在采集空间中查询反射率图像的集合,以获得每个点的反射系数。 然后根据相应的反射系数对变形模型的每个点进行遮蔽,以产生反映变形的物体的图像。

    Skin reflectance model for representing and rendering faces
    3.
    发明申请
    Skin reflectance model for representing and rendering faces 失效
    用于表示和渲染面部的皮肤反射率模型

    公开(公告)号:US20060227137A1

    公开(公告)日:2006-10-12

    申请号:US11092426

    申请日:2005-03-29

    IPC分类号: G06T15/50

    CPC分类号: G06T15/50

    摘要: A face is scanned to obtain a three-dimensional geometry of the face, images are also acquired of the face, and subsurface scattering of the face is measured. A translucency map is determined from the subsurface reflectance. A total surface reflectance and a normal map are estimated from the three-dimensional geometry and the images, and diffuse reflectance is estimated using the total reflectance. An albedo map is determined from the diffuse reflectance. The diffuse reflectance is subtracted from the total reflectance to obtain a surface reflectance. A set of bi-directional reflectance functions is fitted to the surface reflectance. Then, the set of bi-directional reflectance distribution functions, the albedo map, and the translucency map are combined to form a skin reflectance model of the face.

    摘要翻译: 扫描面部以获得脸部的三维几何图像,并且还获取脸部的图像,并且测量脸部的表面下散射。 从地下反射率确定半透明度图。 从三维几何图像和图像估计总表面反射率和法线图,并且使用总反射率来估计漫反射。 从漫反射率确定反照率图。 从总反射率中减去漫反射,得到表面反射率。 一组双向反射函数适合表面反射率。 然后,将该组双向反射分布函数,反照率图和半透明度图组合,以形成面部的皮肤反射率模型。

    Rendering deformable and animated surface reflectance fields
    4.
    发明授权
    Rendering deformable and animated surface reflectance fields 失效
    渲染可变形和动画表面反射场

    公开(公告)号:US07230620B2

    公开(公告)日:2007-06-12

    申请号:US10912724

    申请日:2004-08-05

    IPC分类号: G06T15/60

    CPC分类号: G06T13/20 G06T15/50

    摘要: A method renders a model of an object by first acquiring, in an acquisition space, a reflectance field of the object. The reflectance field includes a set of reflectance images of the object and a point model of the object. The model is deformed in an object space to generate a deformed model. For each point of the deformed model in the object space, the set of the reflectance images is queried in the acquisition space to obtain reflectance coefficients for each point. Each point of the deformed model is then shaded according to the corresponding reflectance coefficients to generate an image of the object reflecting the deforming.

    摘要翻译: 一种方法通过首先在采集空间中获取对象的反射场,从而呈现对象的模型。 反射场包括物体的一组反射图像和物体的点模型。 模型在对象空间中变形以生成变形模型。 对于对象空间中变形模型的每个点,在采集空间中查询反射率图像的集合,以获得每个点的反射系数。 然后根据相应的反射系数对变形模型的每个点进行遮蔽,以产生反映变形的物体的图像。

    DESIGN AND FABRICATION OF MATERIALS WITH DESIRED CHARACTERISTICS FROM BASE MATERIALS HAVING DETERMINED CHARACTERISTICS
    5.
    发明申请
    DESIGN AND FABRICATION OF MATERIALS WITH DESIRED CHARACTERISTICS FROM BASE MATERIALS HAVING DETERMINED CHARACTERISTICS 有权
    具有所需特性的材料的设计和制造具有确定特性的基材

    公开(公告)号:US20120053716A1

    公开(公告)日:2012-03-01

    申请号:US13031036

    申请日:2011-02-18

    IPC分类号: G06F19/00

    摘要: In an object generation system, consumable base materials are characterized in a characterization process wherein an object generation system can use a plurality of so-characterized base materials. User input representing a desired object and set of characteristics for that desired object are processed, using a computer or computing device, to derive a mapping of locations for placement of portions of the plurality of base materials such that when the mapping is provided to an object generator, the generated object approximates the representing a desired object and set of characteristics. The characterization of a base material might include elasticity of the base material, the user input might be a desired shape and elasticity, the object generator might be a 3D multi-material printer and the generated object might at least approximate the desired shape and elasticity as a result of being constructed from the plurality of base materials used by the printer.

    摘要翻译: 在对象生成系统中,消耗性基材的特征在于表征过程,其中对象生成系统可以使用多个如此表征的基材。 使用计算机或计算设备处理表示期望对象的所需对象和特征集的用户输入,以导出用于放置多个基础材料的部分的位置的映射,使得当将映射提供给对象时 生成的对象近似表示期望的对象和特征集合。 基材的表征可能包括基材的弹性,用户输入可能是期望的形状和弹性,对象生成器可以是3D多材料打印机,并且所生成的对象可以至少近似所需的形状和弹性,如 这是由打印机使用的多种基材构成的结果。

    Method for encoding and decoding free viewpoint videos
    6.
    发明授权
    Method for encoding and decoding free viewpoint videos 失效
    免费观看视频的编码和解码方法

    公开(公告)号:US07324594B2

    公开(公告)日:2008-01-29

    申请号:US10723035

    申请日:2003-11-26

    IPC分类号: H04N7/12

    摘要: A system encodes videos acquired of a moving object in a scene by multiple fixed cameras. Camera calibration data of each camera are first determined. The camera calibration data of each camera are associated with the corresponding video. A segmentation mask for each frame of each video is determined. The segmentation mask identifies only foreground pixels in the frame associated with the object. A shape encoder then encodes the segmentation masks, a position encoder encodes a position of each pixel, and a color encoder encodes a color of each pixel. The encoded data can be combined into a single bitstream and transferred to a decoder. At the decoder, the bitstream is decoded to an output video having an arbitrary user selected viewpoint. A dynamic 3D point model defines a geometry of the moving object. Splat sizes and surface normals used during the rendering can be explicitly determined by the encoder, or explicitly by the decoder.

    摘要翻译: 系统通过多个固定摄像机对场景中的移动物体所获取的视频进行编码。 首先确定每个摄像机的摄像机校准数据。 每个摄像机的摄像机校准数据与相应的视频相关联。 确定每个视频的每个帧的分割掩码。 分割掩码仅识别与对象相关联的帧中的前景像素。 然后,形状编码器对分割掩模进行编码,位置编码器对每个像素的位置进行编码,并且颜色编码器对每个像素的颜色进行编码。 编码数据可以组合成单个比特流并传送到解码器。 在解码器处,比特流被解码为具有任意用户选择的视点的输出视频。 动态3D点模型定义了移动物体的几何形状。 在渲染期间使用的Splat尺寸和表面法线可以由编码器显式确定,或者由解码器显式确定。

    Method for encoding and decoding free viewpoint videos
    7.
    发明申请
    Method for encoding and decoding free viewpoint videos 失效
    免费观看视频的编码和解码方法

    公开(公告)号:US20050117019A1

    公开(公告)日:2005-06-02

    申请号:US10723035

    申请日:2003-11-26

    IPC分类号: H04N13/00 H04N5/232 H04N7/18

    摘要: A system encodes videos acquired of a moving object in a scene by multiple fixed cameras. Camera calibration data of each camera are first determined. The camera calibration data of each camera are associated with the corresponding video. A segmentation mask for each frame of each video is determined. The segmentation mask identifies only foreground pixels in the frame associated with the object. A shape encoder then encodes the segmentation masks, a position encoder encodes a position of each pixel, and a color encoder encodes a color of each pixel. The encoded data can be combined into a single bitstream and transferred to a decoder. At the decoder, the bitstream is decoded to an output video having an arbitrary user selected viewpoint. A dynamic 3D point model defines a geometry of the moving object. Splat sizes and surface normals used during the rendering can be explicitly determined by the encoder, or explicitly by the decoder.

    摘要翻译: 系统通过多个固定摄像机对场景中的移动物体所获取的视频进行编码。 首先确定每个摄像机的摄像机校准数据。 每个摄像机的摄像机校准数据与相应的视频相关联。 确定每个视频的每个帧的分割掩码。 分割掩码仅识别与对象相关联的帧中的前景像素。 然后,形状编码器对分割掩模进行编码,位置编码器对每个像素的位置进行编码,并且颜色编码器对每个像素的颜色进行编码。 编码数据可以组合成单个比特流并传送到解码器。 在解码器处,比特流被解码为具有任意用户选择的视点的输出视频。 动态3D点模型定义了移动物体的几何形状。 在渲染期间使用的Splat尺寸和表面法线可以由编码器显式确定,或者由解码器显式确定。

    Fabrication of materials with desired characteristics from base materials having determined characteristics
    8.
    发明授权
    Fabrication of materials with desired characteristics from base materials having determined characteristics 有权
    从具有确定特性的基材制造具有所需特性的材料

    公开(公告)号:US08565909B2

    公开(公告)日:2013-10-22

    申请号:US13031036

    申请日:2011-02-18

    IPC分类号: G06F19/00

    摘要: In an object generation system, consumable base materials are characterized in a characterization process wherein an object generation system can use a plurality of so-characterized base materials. User input representing a desired object and set of characteristics for that desired object are processed, using a computer or computing device, to derive a mapping of locations for placement of portions of the plurality of base materials such that when the mapping is provided to an object generator, the generated object approximates the representing a desired object and set of characteristics. The characterization of a base material might include elasticity of the base material, the user input might be a desired shape and elasticity, the object generator might be a 3D multi-material printer and the generated object might at least approximate the desired shape and elasticity as a result of being constructed from the plurality of base materials used by the printer.

    摘要翻译: 在对象生成系统中,消耗性基材的特征在于表征过程,其中对象生成系统可以使用多个如此表征的基材。 使用计算机或计算设备处理表示期望对象的所需对象和特征集的用户输入,以导出用于放置多个基础材料的部分的位置的映射,使得当将映射提供给对象时 生成的对象近似表示期望的对象和特征集合。 基材的表征可能包括基材的弹性,用户输入可能是期望的形状和弹性,对象生成器可以是3D多材料打印机,并且所生成的对象可以至少近似所需的形状和弹性,如 这是由打印机使用的多种基材构成的结果。

    Silhouette-based pose estimation
    10.
    发明授权
    Silhouette-based pose estimation 有权
    基于轮廓的姿态估计

    公开(公告)号:US09117113B2

    公开(公告)日:2015-08-25

    申请号:US14117593

    申请日:2012-05-08

    IPC分类号: G06K9/00 G06T7/00

    摘要: Estimating a pose of an articulated 3D object model (4) by a computer is done by •obtaining a sequence of source images (10) and therefrom corresponding source image segments (13) with objects (14) separated from the image background; •matching such a sequence (51) with sequences (52) of reference silhouettes (13′), determining one or more selected sequences of reference silhouettes (13′) forming a best match; •for each of these selected sequences of reference silhouettes (13′), retrieving a reference pose that is associated with one of the reference silhouettes (13′); and •computing an estimate of the pose of the articulated object model (4) from the retrieved reference pose or poses. The result of these steps is an initial pose estimate, which then can be used in further steps, for example, for maintaining local consistency between pose estimates from consecutive frames, and global consistency over a longer sequence of frames.

    摘要翻译: 通过计算机估计关节式3D对象模型(4)的姿态是通过以下步骤完成的:通过从图像背景分离的对象(14)获得源图像序列(10)和源自相应源图像片段(13)的序列; •将这样的序列(51)与参考轮廓(13')的序列(52)匹配,确定形成最佳匹配的一个或多个所选择的参考轮廓序列(13'); •对于这些所选择的参考轮廓序列(13')中的每一个,检索与所述参考轮廓(13')之一相关联的参考姿势; 以及•从检索的参考姿势或姿势计算所述铰接对象模型(4)的姿态的估计。 这些步骤的结果是初始姿态估计,其然后可以用于进一步的步骤,例如,用于维持来自连续帧的姿态估计之间的局部一致性,以及在更长的帧序列上的全局一致性。