公开(公告)号：US08934718B2

公开(公告)日：2015-01-13

申请号：US13564418

申请日：2012-08-01

Applicant: Eric Cosatto ,  Christopher Malon ,  Hans P. Graf

Inventor： Eric Cosatto ,  Christopher Malon ,  Hans P. Graf

IPC: G06K9/46 ,  G06K9/00

CPC classification number: G06K9/00979

Abstract: Methods and systems for interactive image analysis include receiving a selection of a region of an image and a request for analysis of the selection at an interface layer, transferring the selection and the request to an interpretation layer for analysis, dividing the selected region of the image into a plurality of sub-sections optimized for parallel computation to provide an analysis result that minimizes perceptible delay between receiving the request and receipt of results, analyzing the sub-sections using one or more execution nodes using a copy of the image stored in a shared memory, and providing combined analysis results to the interface layer for display.

Abstract translation: 用于交互式图像分析的方法和系统包括接收图像的区域的选择和在界面层处的分析选择的请求，将选择和请求传送到用于分析的解释层，分割图像的所选区域 分成针对并行计算优化的多个子部分，以提供最小化接收到请求和接收结果之间的可感知延迟的分析结果，使用一个或多个执行节点使用存储在共享中的图像的副本来分析子部分 内存，并提供组合分析结果到界面层进行显示。

公开(公告)号：US08655035B2

公开(公告)日：2014-02-18

申请号：US13105399

申请日：2011-05-11

Applicant: Christopher D. Malon ,  Atsushi Marugame ,  Eric Cosatto

Inventor： Christopher D. Malon ,  Atsushi Marugame ,  Eric Cosatto

IPC: G06K9/00

CPC classification number: G06K9/00 ,  G06K2209/05 ,  G16H50/20

Abstract: A method for training a classifier to be operative as an epithelial texture classifier, includes obtaining a plurality of training micrograph areas of biopsy tissue and for each of the training micrograph areas, identifying probable locations of nuclei that form epithelia, generating a skeleton graph from the probable locations of the nuclei that form the epithelia, manually drawing walls on the skeleton graph outside of the epithelia to divide the epithelia from one another, and manually selecting points that lie entirely inside the epithelia to generate open and/or closed geodesic paths in the skeleton graph between pairs of the selected points. Data is obtained from points selected from the walls and the paths and applied to a classifier to train the classifier as the epithelial texture classifier. A method and detector for detecting epithelial structures includes applying a sample micrograph area of biopsy tissue to an epithelial texture classifier; identifying probable locations of nuclei that form epithelia of the sample micrograph area with the epithelial texture classifier, generating a skeleton graph from the probable locations of the nuclei that form the epithelia of the sample micrograph area, determining a set of open and/or closed geodesic paths in the skeleton graph of the sample micrograph area; and determining a set of the epithelial masks using the open and/or closed epithelial paths of the sample micrograph area.

Abstract translation: 一种用于训练分类器作为上皮纹理分类器进行操作的方法，包括获得活组织检查组织的多个训练显微照片区域，以及针对每个训练显微照片区域，识别形成上皮细胞核的可能位置，从 形成上皮的细胞核的可能位置，手工地在上皮细胞外的骨架图上绘制壁以将上皮彼此划分，并手动选择完全位于上皮细胞内的点，以在上皮细胞中产生开放和/或封闭的测线路径 所选点对之间的骨架图。 数据从选自墙壁和路径的点获得，并应用于分类器来训练分类器作为上皮纹理分类器。 用于检测上皮结构的方法和检测器包括将活检组织的样品显微照片区域应用于上皮结构分类器; 用上皮结构分类器识别形成样本显微照片区域的上皮的核的可能位置，从形成样品显微照片区域的上皮的细胞核的可能位置产生骨架图，确定一组开放和/或封闭测地线 样品显微照片区域的骨架图中的路径; 以及使用样品显微照片区域的开放和/或闭合的上皮通路确定一组上皮掩模。

公开(公告)号：US20130034279A1

公开(公告)日：2013-02-07

申请号：US13564453

申请日：2012-08-01

Applicant: Eric Cosatto ,  Christopher Malon ,  Hans P. Graf

Inventor： Eric Cosatto ,  Christopher Malon ,  Hans P. Graf

IPC: G06K9/62

CPC classification number: G06K9/00979

Abstract: A method and systems for cloud-based digital pathology include scanning received slides that include a pathology sample to produce a sample image in a shared memory, analyzing the sample image using one or more execution nodes, each including one or more processors, according to one or more analysis types to produce intermediate results, transmitting some or all of the sample image to a client device, further analyzing the sample image responsive to a request from the client device to produce a final analysis based on the intermediate results, and transmitting the final analysis to the client device.

Abstract translation: 用于基于云的数字病理学的方法和系统包括扫描包括病理样本的接收幻灯片，以在共享存储器中产生样本图像，根据一个或多个处理器，使用一个或多个执行节点分析样本图像，每个执行节点包括一个或多个处理器 或更多的分析类型以产生中间结果，将一些或全部样本图像发送到客户端设备，响应于来自客户端设备的请求进一步分析样本图像，以基于中间结果产生最终分析，并且传送最终的 分析到客户端设备。

公开(公告)号：US08086464B2

公开(公告)日：2011-12-27

申请号：US12627573

申请日：2009-11-30

Applicant: Eric Cosatto ,  Hans Peter Graf ,  Joern Ostermann

Inventor： Eric Cosatto ,  Hans Peter Graf ,  Joern Ostermann

IPC: G10L21/00

CPC classification number: G06F17/30905

Abstract: Methods and apparatus for rendering a talking head on a client device are disclosed. The client device has a client cache capable of storing audio/visual data associated with rendering the talking head. The method comprises storing sentences in a client cache of a client device that relate to bridging delays in a dialog, storing sentence templates to be used in dialogs, generating a talking head response to a user inquiry from the client device, and determining whether sentences or stored templates stored in the client cache relate to the talking head response. If the stored sentences or stored templates relate to the talking head response, the method comprises instructing the client device to use the appropriate stored sentence or template from the client cache to render at least a part of the talking head response and transmitting a portion of the talking head response not stored in the client cache, if any, to the client device to render a complete talking head response. If the client cache has no stored data associated with the talking head response, the method comprises transmitting the talking head response to be rendered on the client device.

Abstract translation: 公开了一种用于在客户端设备上呈现通话头的方法和设备。 客户端设备具有能够存储与呈现话音头相关联的音频/视频数据的客户端高速缓存。 该方法包括将客户端设备的客户端缓存中的句子存储在与对话中的桥接延迟相关联，存储要在对话中使用的语句模板，从客户端设备生成对用户的询问头响应，以及确定句子或 存储在客户端缓存中的存储模板涉及到通话头响应。 如果存储的句子或存储的模板与谈话头响应相关，则该方法包括指示客户端设备使用来自客户端高速缓存的适当存储的句子或模板来呈现至少一部分通话头响应并且传送一部分 说话头响应没有存储在客户端缓存中（如果有的话）给客户端设备呈现完整的通话头响应。 如果客户端缓存没有与通话头响应相关联的存储数据，则该方法包括传送要在客户端设备上呈现的通话头响应。

公开(公告)号：US20110293165A1

公开(公告)日：2011-12-01

申请号：US13105399

申请日：2011-05-11

Applicant: Christopher D. Malon ,  Atsushi Marugame ,  Eric Cosatto

Inventor： Christopher D. Malon ,  Atsushi Marugame ,  Eric Cosatto

IPC: G06K9/00 ,  G06N5/02 ,  G06F15/18

CPC classification number: G06K9/00 ,  G06K2209/05 ,  G16H50/20

Abstract: A method for training a classifier to be operative as an epithelial texture classifier, includes obtaining a plurality of training micrograph areas of biopsy tissue and for each of the training micrograph areas, identifying probable locations of nuclei that form epithelia, generating a skeleton graph from the probable locations of the nuclei that form the epithelia, manually drawing walls on the skeleton graph outside of the epithelia to divide the epithelia from one another, and manually selecting points that lie entirely inside the epithelia to generate open and/or closed geodesic paths in the skeleton graph between pairs of the selected points. Data is obtained from points selected from the walls and the paths and applied to a classifier to train the classifier as the epithelial texture classifier. A method and detector for detecting epithelial structures includes applying a sample micrograph area of biopsy tissue to an epithelial texture classifier; identifying probable locations of nuclei that form epithelia of the sample micrograph area with the epithelial texture classifier, generating a skeleton graph from the probable locations of the nuclei that form the epithelia of the sample micrograph area, determining a set of open and/or closed geodesic paths in the skeleton graph of the sample micrograph area; and determining a set of the epithelial masks using the open and/or closed epithelial paths of the sample micrograph area.

Abstract translation: 一种用于训练分类器作为上皮纹理分类器进行操作的方法，包括获得活组织检查组织的多个训练显微照片区域，以及针对每个训练显微照片区域，识别形成上皮细胞核的可能位置，从 形成上皮的细胞核的可能位置，手工地在上皮细胞外的骨架图上绘制壁以将上皮彼此划分，并手动选择完全位于上皮细胞内的点，以在上皮细胞中产生开放和/或封闭的测线路径 所选点对之间的骨架图。 数据从选自墙壁和路径的点获得，并应用于分类器来训练分类器作为上皮纹理分类器。 用于检测上皮结构的方法和检测器包括将活检组织的样品显微照片区域应用于上皮结构分类器; 用上皮结构分类器识别形成样本显微照片区域的上皮的核的可能位置，从形成样品显微照片区域的上皮的细胞核的可能位置产生骨架图，确定一组开放和/或封闭测地线 样品显微照片区域的骨架图中的路径; 以及使用样品显微照片区域的开放和/或闭合的上皮通路确定一组上皮掩模。

公开(公告)号：US07406450B2

公开(公告)日：2008-07-29

申请号：US11276235

申请日：2006-02-20

Applicant: Hans Peter Graf ,  Igor Durdanovic ,  Eric Cosatto ,  Vladimir Vapnik

Inventor： Hans Peter Graf ,  Igor Durdanovic ,  Eric Cosatto ,  Vladimir Vapnik

IPC: G06E1/00 ,  G06E3/00 ,  G06F15/18 ,  G06G7/00 ,  G06N3/02

CPC classification number: G06K9/6269 ,  G06N99/005

Abstract: Disclosed is a parallel support vector machine technique for solving problems with a large set of training data where the kernel computation, as well as the kernel cache and the training data, are spread over a number of distributed machines or processors. A plurality of processing nodes are used to train a support vector machine based on a set of training data. Each of the processing nodes selects a local working set of training data based on data local to the processing node, for example a local subset of gradients. Each node transmits selected data related to the working set (e.g., gradients having a maximum value) and receives an identification of a global working set of training data. The processing node optimizes the global working set of training data and updates a portion of the gradients of the global working set of training data. The updating of a portion of the gradients may include generating a portion of a kernel matrix. These steps are repeated until a convergence condition is met. Each of the local processing nodes may store all, or only a portion of, the training data. While the steps of optimizing the global working set of training data, and updating a portion of the gradients of the global working set, are performed in each of the local processing nodes, the function of generating a global working set of training data is performed in a centralized fashion based on the selected data (e.g., gradients of the local working set) received from the individual processing nodes.

Abstract translation: 公开了一种用于解决大量训练数据的问题的并行支持向量机技术，其中内核计算以及内核高速缓存和训练数据分布在多个分布式机器或处理器上。 多个处理节点用于基于一组训练数据训练支持向量机。 每个处理节点基于处理节点本地的数据，例如梯度的本地子集，选择训练数据的本地工作集。 每个节点发送与工作集有关的所选数据（例如，具有最大值的梯度）并且接收训练数据的全局工作集合的标识。 处理节点优化训练数据的全局工作集，并更新全局训练数据工作集的一部分梯度。 梯度的一部分的更新可以包括生成内核矩阵的一部分。 重复这些步骤直到满足收敛条件。 每个本地处理节点可以存储训练数据的全部或仅一部分。 虽然在每个本地处理节点中执行优化训练数据的全局工作集和更新全局工作集的一部分梯度的步骤，但是在每个本地处理节点中执行生成训练数据的全局工作集的功能， 基于从各个处理节点接收的所选数据（例如，本地工作集的梯度）的集中式。

公开(公告)号：US07177811B1

公开(公告)日：2007-02-13

申请号：US11276556

申请日：2006-03-06

Applicant: Joern Ostermann ,  Barbara Buda ,  Mehmet Reha Civanlar ,  Eric Cosatto ,  Hans Peter Graf ,  Thomas M. Isaacson ,  Yann Andre LeCun

Inventor： Joern Ostermann ,  Barbara Buda ,  Mehmet Reha Civanlar ,  Eric Cosatto ,  Hans Peter Graf ,  Thomas M. Isaacson ,  Yann Andre LeCun

IPC: G10L13/00 ,  G10L13/08

CPC classification number: G10L21/06 ,  G10L13/00 ,  H04L51/10

Abstract: A method is provided for customizing a multi-media message created by a sender for a recipient, in which the multi-media message includes an animated entity audibly presenting speech converted from text by the sender. At least one image is received from the sender. Each of the at least one image is associated with a tag. The sender is presented with options to insert the tag associated with one of the at least one image into the sender text.

Abstract translation: 提供了一种用于定制由发送者为接收者创建的多媒体消息的方法，其中多媒体消息包括可听见地呈现由发送者从文本转换的语音的动画实体。 从发送方接收至少一个图像。 至少一个图像中的每一个与标签相关联。 向发送者呈现选项，将与至少一个图像中的一个相关联的标签插入发送者文本。

公开(公告)号：US20060074688A1

公开(公告)日：2006-04-06

申请号：US11237557

申请日：2005-09-28

Applicant: Eric Cosatto ,  Hans Graf ,  Thomas Isaacson ,  Volker Storm

Inventor： Eric Cosatto ,  Hans Graf ,  Thomas Isaacson ,  Volker Storm

IPC: G10L21/00

CPC classification number: G06T13/40 ,  G10L21/06

Abstract: A system and method of controlling the movement of a virtual agent while the agent is listening to a human user during a conversation is disclosed. The method comprises receiving speech data from the user, performing a prosodic analysis of the speech data and controlling the virtual agent movement according to the prosodic analysis.

Abstract translation: 公开了一种在代理人在对话期间向人类用户收听时控制虚拟代理的移动的系统和方法。 该方法包括从用户接收语音数据，对语音数据执行韵律分析，并根据韵律分析来控制虚拟代理的移动。

公开(公告)号：US20050057570A1

公开(公告)日：2005-03-17

申请号：US10662550

申请日：2003-09-15

Applicant: Eric Cosatto ,  Hans Graf ,  Gerasimos Potamianos ,  Juergen Schroeter

Inventor： Eric Cosatto ,  Hans Graf ,  Gerasimos Potamianos ,  Juergen Schroeter

IPC: G06T15/70 ,  G10L15/02 ,  G10L21/06

CPC classification number: G06T13/40 ,  G10L2015/025 ,  G10L2021/105 ,  Y10S345/956 ,  Y10S345/957

Abstract: A system and method for generating photo-realistic talking-head animation from a text input utilizes an audio-visual unit selection process. The lip-synchronization is obtained by optimally selecting and concatenating variable-length video units of the mouth area. The unit selection process utilizes the acoustic data to determine the target costs for the candidate images and utilizes the visual data to determine the concatenation costs. The image database is prepared in a hierarchical fashion, including high-level features (such as a full 3D modeling of the head, geometric size and position of elements) and pixel-based, low-level features (such as a PCA-based metric for labeling the various feature bitmaps).

Abstract translation: 用于从文本输入生成照片真实的讲话头动画的系统和方法利用视听单元选择过程。 通过最佳地选择并连接口区的可变长度视频单元来获得唇同步。 单元选择过程利用声学数据来确定候选图像的目标成本，并利用视觉数据来确定连接成本。 以分层方式准备图像数据库，包括高级特征（例如头部的完整3D建模，元件的几何尺寸和位置）和基于像素的低级特征（例如基于PCA的度量 用于标记各种功能位图）。

公开(公告)号：US06662161B1

公开(公告)日：2003-12-09

申请号：US09390704

申请日：1999-09-07

Applicant: Eric Cosatto ,  Hans Peter Graf ,  Juergen Schroeter

Inventor： Eric Cosatto ,  Hans Peter Graf ,  Juergen Schroeter

IPC: G10L1308

CPC classification number: G10L13/00 ,  G10L2021/105

Abstract: A method for generating animated sequences of talking heads in text-to-speech applications wherein a processor samples a plurality of frames comprising image samples. Representative parameters are extracted from the image samples and stored in an animation library. The processor also samples a plurality of multiphones comprising images together with their associated sounds. The processor extracts parameters from these images comprising data characterizing mouth shapes, maps, rules, or equations, and stores the resulting parameters and sound information in a coarticulation library. The animated sequence begins with the processor considering an input phoneme sequence, recalling from the coarticulation library parameters associated with that sequence, and selecting appropriate image samples from the animation library based on that sequence. The image samples are concatenated together, and the corresponding sound is output, to form the animated synthesis.

Abstract translation: 一种在文本到语音应用中产生通话头的动画序列的方法，其中处理器对包括图像样本的多个帧进行采样。 从图像样本中提取代表性参数并存储在动画库中。 处理器还对包括图像及其相关联的声音的多个多声道进行采样。 处理器从这些图像中提取参数，包括表征口形，地图，规则或方程式的数据，并将所得到的参数和声音信息存储在协同库中。 动画序列从考虑输入音素序列的处理器开始，从与该序列相关联的协方差库中调用，并且基于该序列从动画库中选择合适的图像样本。 将图像样本连接在一起，输出相应的声音，形成动画合成。