公开(公告)号：US06654018B1

公开(公告)日：2003-11-25

申请号：US09820396

申请日：2001-03-29

Applicant: Eric Cosatto ,  Hans Peter Graf ,  Gerasimos Potamianos ,  Juergen Schroeter

Inventor： Eric Cosatto ,  Hans Peter Graf ,  Gerasimos Potamianos ,  Juergen Schroeter

IPC: G06T1300

CPC classification number: G10L13/08 ,  G10L2021/105

Abstract: A system and method for generating photo-realistic talking-head animation from a text input utilizes an audio-visual unit selection process. The lip-synchronization is obtained by optimally selecting and concatenating variable-length video units of the mouth area. The unit selection process utilizes the acoustic data to determine the target costs for the candidate images and utilizes the visual data to determine the concatenation costs. The image database is prepared in a hierarchical fashion, including high-level features (such as a full 3D modeling of the head, geometric size and position of elements) and pixel-based, low-level features (such as a PCA-based metric for labeling the various feature bitmaps).

Abstract translation: 用于从文本输入生成照片真实的讲话头动画的系统和方法利用视听单元选择过程。 通过最佳地选择并连接口区的可变长度视频单元来获得唇同步。 单元选择过程利用声学数据来确定候选图像的目标成本，并利用视觉数据来确定连接成本。 以分层方式准备图像数据库，包括高级特征（例如头部的完整3D建模，元件的几何尺寸和位置）和基于像素的低级特征（例如基于PCA的度量 用于标记各种功能位图）。

公开(公告)号：US06504546B1

公开(公告)日：2003-01-07

申请号：US09500334

申请日：2000-02-08

Applicant: Eric Cosatto ,  Hans Peter Graf

Inventor： Eric Cosatto ,  Hans Peter Graf

IPC: G06T1700

CPC classification number: G06T13/40 ,  G10L2021/105

Abstract: A method for modeling three-dimensional objects to create photo-realistic animations using a data-driven approach. The three-dimensional object is defined by a set of separate three-dimensional planes, each plane enclosing an area of the object that undergoes visual changes during animation. Recorded video is used to create bitmap data to populate a database for each three-dimensional plane. The video is analyzed in terms of both rigid movements (changes in pose) and plastic deformation (changes in expression) to create the bitmaps. The modeling is particularly well-suited for animations of a human face, where an audio track generated by a text-to-speech synthesizer can be added to the animation to create a photo-realistic “talking head”.

Abstract translation: 一种用于建模三维对象以使用数据驱动方法创建照片逼真动画的方法。 三维物体由一组单独的三维平面定义，每个平面包围在动画期间经历视觉变化的对象的区域。 录制的视频用于创建位图数据以填充每个三维平面的数据库。 根据刚性运动（姿势变化）和塑性变形（表达式的变化）分析视频以创建位图。 该建模特别适用于人脸的动画，其中由文本到语音合成器生成的音轨可以被添加到动画中以创建照片般逼真的“说话头”。

公开(公告)号：US6118887A

公开(公告)日：2000-09-12

申请号：US948750

申请日：1997-10-10

Applicant: Eric Cosatto ,  Hans Peter Graf ,  Gerasimos Potamianos

Inventor： Eric Cosatto ,  Hans Peter Graf ,  Gerasimos Potamianos

IPC: G06K9/00 ,  G06T7/20

CPC classification number: G06K9/00228 ,  G06T7/2033

Abstract: A method for tracking heads and faces is disclosed wherein a variety of different representation models can be used to define individual heads and facial features in a multi-channel capable tracking algorithm. The representation models generated by the channels during a sequence of frames are ultimately combined into a representation comprising a highly robust and accurate tracked output. In a preferred embodiment, the method conducts an initial overview procedure to establish the optimal tracking strategy to be used in light of the particular characteristics of the tracking application.

Abstract translation: 公开了用于跟踪头部和面部的方法，其中可以使用各种不同的表示模型来在多通道能力跟踪算法中定义单独的头部和面部特征。 在帧序列期间由信道产生的表示模型最终被组合成包括高度鲁棒且准确的跟踪输出的表示。 在优选实施例中，该方法进行初始概览过程以根据跟踪应用的特定特征建立要使用的最佳跟踪策略。

公开(公告)号：US08897537B2

公开(公告)日：2014-11-25

申请号：US13564453

申请日：2012-08-01

Applicant: Eric Cosatto ,  Christopher Malon ,  Hans P. Graf

Inventor： Eric Cosatto ,  Christopher Malon ,  Hans P. Graf

IPC: G06K9/00

CPC classification number: G06K9/00979

Abstract: A method and systems for cloud-based digital pathology include scanning received slides that include a pathology sample to produce a sample image in a shared memory, analyzing the sample image using one or more execution nodes, each including one or more processors, according to one or more analysis types to produce intermediate results, transmitting some or all of the sample image to a client device, further analyzing the sample image responsive to a request from the client device to produce a final analysis based on the intermediate results, and transmitting the final analysis to the client device.

Abstract translation: 用于基于云的数字病理学的方法和系统包括扫描包括病理样本的接收幻灯片，以在共享存储器中产生样本图像，根据一个或多个处理器，使用一个或多个执行节点分析样本图像，每个执行节点包括一个或多个处理器 或更多的分析类型以产生中间结果，将一些或全部样本图像发送到客户端设备，响应于来自客户端设备的请求进一步分析样本图像，以基于中间结果产生最终分析，并且传送最终的 分析到客户端设备。

公开(公告)号：US20130034304A1

公开(公告)日：2013-02-07

申请号：US13564437

申请日：2012-08-01

Applicant: Eric Cosatto ,  Christopher Malon ,  Hans P. Graf

Inventor： Eric Cosatto ,  Christopher Malon ,  Hans P. Graf

IPC: G06K9/46

CPC classification number: G06K9/00979

Abstract: Methods and systems for digital pathology with low-latency analytics include determining potential regions of interest within an image in accordance with one or more high-priority analyses, dividing the potential regions of interest into a plurality of sub-sections optimized for parallel computation, analyzing the sub-sections using one or more execution nodes, each including one or more processors, using a copy of the image stored in a shared memory according to the one or more high-priority analyses, and storing an intermediate analysis result based on analysis results from the one or more execution nodes in a shared memory.

Abstract translation: 具有低延迟分析的数字病理学方法和系统包括根据一个或多个高优先级分析来确定图像内的感兴趣区域，将感兴趣的潜在区域划分为针对并行计算优化的多个子部分，分析 使用根据所述一个或多个高优先级分析的存储在共享存储器中的图像的副本的每个包括一个或多个处理器的一个或多个执行节点的子部分，以及基于分析结果存储中间分析结果 来自共享存储器中的一个或多个执行节点。

公开(公告)号：US20130034301A1

公开(公告)日：2013-02-07

申请号：US13564418

申请日：2012-08-01

Applicant: Eric Cosatto ,  Christopher Malon ,  Hans P. Graf

Inventor： Eric Cosatto ,  Christopher Malon ,  Hans P. Graf

IPC: G06K9/34

CPC classification number: G06K9/00979

Abstract: Methods and systems for interactive image analysis include receiving a selection of a region of an image and a request for analysis of the selection at an interface layer, transferring the selection and the request to an interpretation layer for analysis, dividing the selected region of the image into a plurality of sub-sections optimized for parallel computation to provide an analysis result that minimizes perceptible delay between receiving the request and receipt of results, analyzing the sub-sections using one or more execution nodes using a copy of the image stored in a shared memory, and providing combined analysis results to the interface layer for display.

Abstract translation: 用于交互式图像分析的方法和系统包括接收图像的区域的选择和在界面层处的分析选择的请求，将选择和请求传送到用于分析的解释层，分割图像的所选区域 分成针对并行计算优化的多个子部分，以提供最小化接收到请求和接收结果之间的可感知延迟的分析结果，使用一个或多个执行节点使用存储在共享中的图像的副本来分析子部分 内存，并提供组合分析结果到界面层进行显示。

公开(公告)号：US08359281B2

公开(公告)日：2013-01-22

申请号：US12478073

申请日：2009-06-04

Applicant: Srihari Cadambi ,  Igor Durdanovic ,  Venkata Jakkula ,  Eric Cosatto ,  Murugan Sankaradass ,  Hans Peter Graf ,  Srimat T. Chakradhar

Inventor： Srihari Cadambi ,  Igor Durdanovic ,  Venkata Jakkula ,  Eric Cosatto ,  Murugan Sankaradass ,  Hans Peter Graf ,  Srimat T. Chakradhar

IPC: G06F15/18

CPC classification number: G06N99/005

Abstract: A method system for training an apparatus to recognize a pattern includes providing the apparatus with a host processor executing steps of a machine learning process; providing the apparatus with an accelerator including at least two processors; inputting training pattern data into the host processor; determining coefficient changes in the machine learning process with the host processor using the training pattern data; transferring the training data to the accelerator; determining kernel dot-products with the at least two processors of the accelerator using the training data; and transferring the dot-products back to the host processor.

Abstract translation: 用于训练识别模式的装置的方法系统包括向所述装置提供执行机器学习过程的步骤的主机处理器; 向所述设备提供包括至少两个处理器的加速器; 将训练模式数据输入到主处理器中; 使用所述训练模式数据来确定主处理器在机器学习过程中的系数变化; 将训练数据传送到加速器; 使用所述训练数据确定具有所述加速器的所述至少两个处理器的内核点产品; 并将点产品传送回主机处理器。

公开(公告)号：US20120243788A1

公开(公告)日：2012-09-27

申请号：US13315487

申请日：2011-12-09

Applicant: CHRISTOPHER MALON ,  ERIC COSATTO

Inventor： CHRISTOPHER MALON ,  ERIC COSATTO

IPC: G06K9/46

CPC classification number: G06T7/0012 ,  G06K9/00127 ,  G06T7/12 ,  G06T2207/30024

Abstract: Systems and methods for extracting a radial contour around a given point in an image includes providing an image including a point about which a radial contour is to be extracted around. A plurality of directions around the point and a plurality of radius lengths for each direction are provided. Local costs are determined for all radius lengths for each direction by comparing texture variances at each radius length with the texture variance at a further radius length. A radius length is determined, using a processor, for each direction based on the accumulated value of the local costs to provide a radial contour.

Abstract translation: 用于提取图像中的给定点周围的径向轮廓的系统和方法包括提供包括要围绕其提取径向轮廓的点的图像。 提供了围绕该点的多个方向和每个方向的多个半径长度。 通过将每个半径长度处的纹理方差与另一半径长度上的纹理方差进行比较，确定每个方向的所有半径长度的局部花费。 使用处理器，根据本地成本的累积值来确定每个方向的半径长度以提供径向轮廓。

公开(公告)号：US20110295520A1

公开(公告)日：2011-12-01

申请号：US13115562

申请日：2011-05-25

Applicant: Eric Cosatto ,  Christopher D. Malon ,  Hans Peter Graf

Inventor： Eric Cosatto ,  Christopher D. Malon ,  Hans Peter Graf

IPC: G06F19/00

CPC classification number: G06K9/0014 ,  G06T7/0012 ,  G06T2207/10024 ,  G06T2207/10056 ,  G06T2207/30024

Abstract: A method for measuring structural entropy of cell nuclei in a histological micrograph of a biopsy tissue sample involves the steps of: obtaining a dye color map from a color image of the biopsy tissue sample; locating cell nuclei in the dye color map; and measuring structural features within small groups (cliques or paths) of cell nuclei to determine their degree of organization (or structural entropy). Also, an apparatus for measuring structural entropy of cell nuclei in a histological micrograph of a biopsy tissue sample includes a processor executing instructions for: obtaining a dye color map of the biopsy tissue sample; locating cell nuclei in the dye color map; and measuring structural features within small groups (cliques or paths) of cell nuclei to determine their degree of organization (or structural entropy).

Abstract translation: 在活检组织样本的组织学显微照片中测量细胞核结构熵的方法包括以下步骤：从活检组织样品的彩色图像获得染色色图; 在染色图中定位细胞核; 并测量细胞核的小组（团块或路径）内的结构特征，以确定其组织程度（或结构熵）。 此外，用于测量活检组织样本的组织学显微照片中的细胞核的结构熵的装置包括执行指令的处理器，用于获得活组织样本的染色图; 在染色图中定位细胞核; 并测量细胞核的小组（团块或路径）内的结构特征，以确定其组织程度（或结构熵）。

公开(公告)号：US20110002508A1

公开(公告)日：2011-01-06

申请号：US12877644

申请日：2010-09-08

Applicant: Andrea Basso ,  Eric Cosatto ,  David Crawford Gibbon ,  Hans Peter Graf ,  Shan Liu

Inventor： Andrea Basso ,  Eric Cosatto ,  David Crawford Gibbon ,  Hans Peter Graf ,  Shan Liu

IPC: G06K9/00

CPC classification number: G06K9/00281 ,  G06F3/012 ,  G06K9/00228 ,  G06K9/2027 ,  G06T7/246 ,  G06T15/50 ,  G06T17/00 ,  G06T2200/08 ,  G06T2207/10152 ,  G06T2207/30201 ,  H04N7/147 ,  H04N7/15

Abstract: A method of improving the lighting conditions of a real scene or video sequence. Digitally generated light is added to a scene for video conferencing over telecommunication networks. A virtual illumination equation takes into account light attenuation, lambertian and specular reflection. An image of an object is captured, a virtual light source illuminates the object within the image. In addition, the object can be the head of the user. The position of the head of the user is dynamically tracked so that an three-dimensional model is generated which is representative of the head of the user. Synthetic light is applied to a position on the model to form an illuminated model.

Abstract translation: 一种改善真实场景或视频序列的照明条件的方法。 数字生成的光被添加到通过电信网络进行视频会议的场景中。 虚拟照明方程考虑了光衰减，朗伯和镜面反射。 捕获对象的图像，虚拟光源照亮图像内的对象。 另外，对象可以是用户的头。 动态跟踪用户头部的位置，从而生成代表用户头部的三维模型。 将合成光应用于模型上的位置以形成照明模型。