Incremental global non-rigid alignment of three-dimensional scans

    公开(公告)号:US09665937B2

    公开(公告)日:2017-05-30

    申请号:US14803617

    申请日:2015-07-20

    Inventor: Linjie Luo

    CPC classification number: G06T7/90 G06T7/33 G06T7/593 G06T2207/10016

    Abstract: Techniques are provided for incrementally aligning multiple scans of a three-dimensional subject. This can be accomplished by establishing an updated aligned set of scans as each new scan is sequentially processed and aligned with the existing scans. In such embodiments the pairwise and global alignment processes are effectively combined into a single collective alignment process. This collective alignment converges to an optimal alignment faster than the sequential pairwise alignment process that existing solutions use. The collective alignment enforces pairwise alignment between the individual scans in the aligned set of scans. This is because each scan comprising the aligned set can be aligned to the next incremental scan if any scan included in the aligned set can be aligned to the next incremental scan. The pairwise alignment between the scans comprising the aligned set is thus a known function.

    Facial Expression Capture for Character Animation
    3.
    发明申请
    Facial Expression Capture for Character Animation 有权
    角色动画面部表情捕捉

    公开(公告)号:US20160275341A1

    公开(公告)日:2016-09-22

    申请号:US14661788

    申请日:2015-03-18

    Abstract: Techniques for facial expression capture for character animation are described. In one or more implementations, facial key points are identified in a series of images. Each image, in the series of images, is normalized from the identified facial key points. Facial features are determined from each of the normalized images. Then a facial expression is classified, based on the determined facial features, for each of the normalized images. In additional implementations, a series of images are captured that include performances of one or more facial expressions. The facial expressions in each image of the series of images are classified by a facial expression classifier. Then the facial expression classifications are used by a character animator system to produce a series of animated images of an animated character that include animated facial expressions that are associated with the facial expression classification of the corresponding image in the series of images.

    Abstract translation: 描述了用于人物动画的面部表情捕获的技术。 在一个或多个实现中,在一系列图像中识别面部关键点。 一系列图像中的每个图像都从识别的面部关键点进行归一化。 从每个标准化图像确定面部特征。 然后,基于所确定的面部特征,针对每个标准化图像分类面部表情。 在另外的实现中,捕获包括一个或多个面部表情的表现的一系列图像。 一系列图像的每个图像中的面部表情由面部表情分类器分类。 然后,人物动画师系统使用面部表情分类来产生动画角色的一系列动画图像,其包括与一系列图像中的对应图像的面部表情分类相关联的动画面部表情。

    3D Model Enhancement
    4.
    发明申请
    3D Model Enhancement 有权
    3D模型增强

    公开(公告)号:US20150206344A1

    公开(公告)日:2015-07-23

    申请号:US14159870

    申请日:2014-01-21

    Abstract: One embodiment involves receiving a fine mesh as input, the fine mesh representing a 3-Dimensional (3D) model and comprising fine mesh polygons. The embodiment further involves identifying, based on the fine mesh, near-planar regions represented by a coarse mesh of coarse mesh polygons, at least one of the near-planar regions corresponding to a plurality of the coarse mesh polygons. The embodiment further involves determining a deformation to deform the coarse mesh based on comparing normals between adjacent coarse mesh polygons. The deformation may involve reducing a first angle between coarse mesh polygons adjacent to one another in a same near-planar region. The deformation may additionally or alternatively involve increasing an angle between coarse mesh polygons adjacent to one another in different near-planar regions. The fine mesh can be deformed using the determined deformation.

    Abstract translation: 一个实施例涉及接收细网格作为输入,细网格表示三维(3D)模型并且包括细网格多边形。 该实施例还包括基于细网格识别由粗网格多边形的粗网格表示的近平面区域,对应于多个粗网格多边形的至少一个近平面区域。 该实施例还涉及基于相邻粗网格多边形之间的比较法确定变形以使粗网格变形。 变形可以涉及在相同的近平面区域中减小彼此相邻的粗网格多边形之间的第一角度。 变形可以额外地或替代地涉及在不同的近平面区域中增加彼此相邻的粗网格多边形之间的角度。 细网可以使用确定的变形来变形。

    Aligning multi-view scans
    6.
    发明授权
    Aligning multi-view scans 有权
    对齐多视图扫描

    公开(公告)号:US09286682B1

    公开(公告)日:2016-03-15

    申请号:US14550767

    申请日:2014-11-21

    Abstract: Alignment techniques are described that automatically align multiple scans of an object obtained from different perspectives. Instead of relying solely on errors in local feature matching between a pair of scans to identify a best possible alignment, additional alignment possibilities may be considered. Grouped keypoint features of the pair of scans may be compared to keypoint features of an additional scan to determine an error between the respective keypoint features. Various alignment techniques may utilize the error to determine an optimal alignment for the scans.

    Abstract translation: 描述了对齐技术,自动对齐从不同视角获得的对象的多次扫描。 不是仅仅依赖于一对扫描之间的局部特征匹配中的错误来识别最佳可能的对准,可以考虑附加的对准可能性。 可以将该对扫描的分组关键点特征与附加扫描的关键点特征进行比较,以确定各个关键点特征之间的误差。 各种校准技术可以利用误差来确定扫描的最佳对准。

    Facial expression capture for character animation
    7.
    发明授权
    Facial expression capture for character animation 有权
    面部表情捕捉角色动画

    公开(公告)号:US09552510B2

    公开(公告)日:2017-01-24

    申请号:US14661788

    申请日:2015-03-18

    Abstract: Techniques for facial expression capture for character animation are described. In one or more implementations, facial key points are identified in a series of images. Each image, in the series of images, is normalized from the identified facial key points. Facial features are determined from each of the normalized images. Then a facial expression is classified, based on the determined facial features, for each of the normalized images. In additional implementations, a series of images are captured that include performances of one or more facial expressions. The facial expressions in each image of the series of images are classified by a facial expression classifier. Then the facial expression classifications are used by a character animator system to produce a series of animated images of an animated character that include animated facial expressions that are associated with the facial expression classification of the corresponding image in the series of images.

    Abstract translation: 描述了用于人物动画的面部表情捕获的技术。 在一个或多个实现中,在一系列图像中识别面部关键点。 一系列图像中的每个图像都从识别的面部关键点进行归一化。 从每个标准化图像确定面部特征。 然后,基于所确定的面部特征,针对每个标准化图像分类面部表情。 在另外的实现中,捕获包括一个或多个面部表情的表现的一系列图像。 一系列图像的每个图像中的面部表情由面部表情分类器分类。 然后,人物动画师系统使用面部表情分类来产生动画角色的一系列动画图像,其包括与一系列图像中的对应图像的面部表情分类相关联的动画面部表情。

    3D model enhancement
    8.
    发明授权
    3D model enhancement 有权
    3D模型增强

    公开(公告)号:US09520001B2

    公开(公告)日:2016-12-13

    申请号:US14159870

    申请日:2014-01-21

    Abstract: One embodiment involves receiving a fine mesh as input, the fine mesh representing a 3-Dimensional (3D) model and comprising fine mesh polygons. The embodiment further involves identifying, based on the fine mesh, near-planar regions represented by a coarse mesh of coarse mesh polygons, at least one of the near-planar regions corresponding to a plurality of the coarse mesh polygons. The embodiment further involves determining a deformation to deform the coarse mesh based on comparing normals between adjacent coarse mesh polygons. The deformation may involve reducing a first angle between coarse mesh polygons adjacent to one another in a same near-planar region. The deformation may additionally or alternatively involve increasing an angle between coarse mesh polygons adjacent to one another in different near-planar regions. The fine mesh can be deformed using the determined deformation.

    Abstract translation: 一个实施例涉及接收细网格作为输入,细网格表示三维(3D)模型并且包括细网格多边形。 该实施例还包括基于细网格识别由粗网格多边形的粗网格表示的近平面区域,对应于多个粗网格多边形的至少一个近平面区域。 该实施例还涉及基于相邻粗网格多边形之间的比较法确定变形以使粗网格变形。 变形可以涉及在相同的近平面区域中减小彼此相邻的粗网格多边形之间的第一角度。 变形可以额外地或替代地涉及在不同的近平面区域中增加彼此相邻的粗网格多边形之间的角度。 细网可以使用确定的变形来变形。

    INCREMENTAL GLOBAL NON-RIGID ALIGNMENT OF THREE-DIMENSIONAL SCANS
    9.
    发明申请
    INCREMENTAL GLOBAL NON-RIGID ALIGNMENT OF THREE-DIMENSIONAL SCANS 有权
    三维扫描的全球非球面对准

    公开(公告)号:US20160335771A1

    公开(公告)日:2016-11-17

    申请号:US14803617

    申请日:2015-07-20

    Inventor: Linjie Luo

    CPC classification number: G06T7/90 G06T7/33 G06T7/593 G06T2207/10016

    Abstract: Techniques are provided for incrementally aligning multiple scans of a three-dimensional subject. This can be accomplished by establishing an updated aligned set of scans as each new scan is sequentially processed and aligned with the existing scans. In such embodiments the pairwise and global alignment processes are effectively combined into a single collective alignment process. This collective alignment converges to an optimal alignment faster than the sequential pairwise alignment process that existing solutions use. The collective alignment enforces pairwise alignment between the individual scans in the aligned set of scans. This is because each scan comprising the aligned set can be aligned to the next incremental scan if any scan included in the aligned set can be aligned to the next incremental scan. The pairwise alignment between the scans comprising the aligned set is thus a known function.

    Abstract translation: 提供了用于逐渐对准三维对象的多次扫描的技术。 这可以通过建立更新的对齐的扫描集合来实现,因为每个新扫描被顺序处理并与现有扫描对准。 在这样的实施例中,成对和全局对准过程被有效地组合成单个集体对齐过程。 这种集体对齐方式比现有解决方案使用的顺序成对对齐过程更快地收敛到最佳对齐。 集体对齐在对齐的一组扫描中强制成对的对齐。 这是因为包括对齐组的每个扫描可以对齐到下一个增量扫描,如果对齐集合中包含的任何扫描可以与下一个增量扫描对齐。 因此,包括对齐组的扫描之间的成对对准因此是已知的功能。

    3-Dimensional Portrait Reconstruction From a Single Photo
    10.
    发明申请
    3-Dimensional Portrait Reconstruction From a Single Photo 有权
    从单张照片三维人像重建

    公开(公告)号:US20160314619A1

    公开(公告)日:2016-10-27

    申请号:US14695727

    申请日:2015-04-24

    Abstract: Systems and methods are disclosed herein for 3-Dimensional portrait reconstruction from a single photo. A face portion of a person depicted in a portrait photo is detected and a 3-Dimensional model of the person depicted in the portrait photo constructed. In one embodiment, constructing the 3-Dimensional model involves fitting hair portions of the portrait photo to one or more helices. In another embodiment, constructing the 3-Dimensional model involves applying positional and normal boundary conditions determined based on one or more relationships between face portion shape and hair portion shape. In yet another embodiment, constructing the 3-Dimensional model involves using shape from shading to capture fine-scale details in a form of surface normals, the shape from shading based on an adaptive albedo model and/or a lighting condition estimated based on shape fitting the face portion.

    Abstract translation: 本文公开了用于从单张照片进行三维人像重构的系统和方法。 检测肖像照片中描绘的人的面部部分,并且构建在肖像照片中描绘的人的三维模型。 在一个实施例中,构建三维模型涉及将肖像照片的头发部分适合于一个或多个螺旋。 在另一个实施例中,构造三维模型包括应用基于面部部分形状和头发部分形状之间的一个或多个关系确定的位置和正常边界条件。 在另一个实施例中,构造三维模型涉及使用阴影的形状来以表面法线的形式捕获精细尺度的细节,基于自适应反照率模型的阴影形状和/或基于形状拟合估计的照明条件 面部分。

Patent Agency Ranking