公开(公告)号：US07254285B1

公开(公告)日：2007-08-07

申请号：US09831215

申请日：1999-11-05

申请人： Seungup Paek ,  Ana Benitez ,  Shih-Fu Chang ,  Chung-Sheng Li ,  John R. Smith ,  Lawrence D. Bergman ,  Atul Puri ,  Qian Huang

发明人： Seungup Paek ,  Ana Benitez ,  Shih-Fu Chang ,  Chung-Sheng Li ,  John R. Smith ,  Lawrence D. Bergman ,  Atul Puri ,  Qian Huang

IPC分类号： G06K9/60

CPC分类号： G06K9/4685

摘要： Systems and methods for describing image content establish image description records which include an object set (24), an object hierarchy (26) and entity relation graphs (28). For image content, image objects can include global objects (O0 8) and local objects (O1 2 and O2 6). The image objects are further defined by a number of features of different classes (36, 38 and 40), which in turn are further defined by a number of feature descriptors. The relationships between and among the objects in the object set are defined by the object hierarchy (26) and entity relation graphs (28). The image description records provide a standard vehicle for describing the content and context of image information for subsequent access and processing by computer applications such as search engines, filters, and archive systems.

摘要翻译： 用于描述图像内容的系统和方法建立包括对象集（24），对象层次（26）和实体关系图（28）的图像描述记录。 对于图像内容，图像对象可以包括全局对象（O 0 8）和本地对象（O 1 2和O 2 6）。 图像对象由不同类别（36,38和40）的许多特征进一步限定，这些特征又由许多特征描述符进一步限定。 对象集合中的对象之间和之间的关系由对象层次结构（26）和实体关系图（28）定义。 图像描述记录提供用于描述图像信息的内容和上下文的标准车辆，用于随后由计算机应用（例如搜索引擎，过滤器和归档系统）的访问和处理。

公开(公告)号：US08370869B2

公开(公告)日：2013-02-05

申请号：US11448114

申请日：2006-06-06

申请人： Seungyup Paek ,  Ana Benitez ,  Shih-Fu Chang ,  Atul Puri ,  Qian Huang ,  Chung-Sheng Li ,  John R. Smith ,  Lawrence Bergman

发明人： Seungyup Paek ,  Ana Benitez ,  Shih-Fu Chang ,  Atul Puri ,  Qian Huang ,  Chung-Sheng Li ,  John R. Smith ,  Lawrence Bergman

IPC分类号： H04H60/32 ,  G06K9/00

CPC分类号： G06K9/00711 ,  G06F17/30858 ,  G06K9/468

摘要： Systems and methods for describing video content establish video description records which include an object set (24), an object hierarchy (26) and entity relation graphs (28). Video objects can include global objects, segment objects and local objects. The video objects are further defined by a number of features organized in classes, which in turn are further defined by a number of feature descriptors (36, 38, and 40). The relationships (44) between and among the objects in the object set (24) are defined by the object hierarchy (26) and entity relation graphs (28). The video description records provide a standard vehicle for describing the content and context of video information for subsequent access and processing by computer applications such as search engines, filters and archive systems.

摘要翻译： 用于描述视频内容的系统和方法建立包括对象集（24），对象层次（26）和实体关系图（28）的视频描述记录。 视频对象可以包括全局对象，段对象和本地对象。 视频对象由类别中组织的多个特征进一步限定，这些特征又由多个特征描述符（36,38和40）进一步限定。 对象集合（24）中的对象之间和之间的关系（44）由对象层次结构（26）和实体关系图（28）定义。 视频描述记录提供用于描述视频信息的内容和上下文的标准车辆，以便随后通过计算机应用（例如搜索引擎，过滤器和归档系统）进行访问和处理。

公开(公告)号：US07143434B1

公开(公告)日：2006-11-28

申请号：US09831218

申请日：1999-11-05

申请人： Seungyup Paek ,  Ana Benitez ,  Shih-Fu Chang ,  Atul Puri ,  Chung-Sheng Li ,  John R. Smith ,  Lawrence Bergman

发明人： Seungyup Paek ,  Ana Benitez ,  Shih-Fu Chang ,  Atul Puri ,  Chung-Sheng Li ,  John R. Smith ,  Lawrence Bergman

IPC分类号： G09G5/00 ,  H04B1/66 ,  G06K9/00

CPC分类号： G06K9/00711 ,  G06F17/30858 ,  G06K9/468

摘要： The present invention relates to a system for generating a description record from multimedia information including, e.g., video data. A multimedia information input interface is used to receive multimedia information. A computer processor receives the multimedia information, processes the video information by performing video object extraction processing to generate video object descriptions from the video information, processes the generated video object descriptions by object hierarchy construction and extraction processing to generate video object hierarchy descriptions, and processes the generated video object descriptions by entity relation graph descriptions.

摘要翻译： 本发明涉及一种用于从包括例如视频数据的多媒体信息产生描述记录的系统。 多媒体信息输入接口用于接收多媒体信息。 计算机处理器接收多媒体信息，通过执行视频对象提取处理来处理视频信息以从视频信息生成视频对象描述，通过对象层次结构和提取处理处理所生成的视频对象描述以产生视频对象层级描述，以及处理 通过实体关系图描述生成的视频对象描述。

公开(公告)号：US07130805B2

公开(公告)日：2006-10-31

申请号：US10047863

申请日：2002-01-16

申请人： Lawrence D. Bergman ,  Yuan-Chi Chang ,  Chung-Sheng Li ,  John R. Smith

发明人： Lawrence D. Bergman ,  Yuan-Chi Chang ,  Chung-Sheng Li ,  John R. Smith

IPC分类号： G06F17/60

CPC分类号： G06Q10/06 ,  G06Q10/067 ,  Y10S707/99934 ,  Y10S707/99936

摘要： The invention provides a next generation decision support system that includes highly adaptive sensors, transport, and models to enable time critical decision making. The decision support model of the system is progressive so that not all input parameters need to be available to produce model prediction output. Input parameters of the model with the largest first order derivative values are given highest priority in data acquisition and transmission. The parameters acquired at the sensors are stored in progressive data representation formats, which later on are progressively transmitted to the decision support server. Progressive data representation, progressive transmission, and progressive model are thus three key elements that need to be integrated together. The present invention presents a method and an apparatus that form an optimized process including the three elements subject to the decision making utility function.

公开(公告)号：US06847980B1

公开(公告)日：2005-01-25

申请号：US09607974

申请日：2000-06-30

申请人： Ana B. Benitez ,  Alejandro Jaimes ,  Shih-Fu Chang ,  John R. Smith ,  Chung-sheng Li

发明人： Ana B. Benitez ,  Alejandro Jaimes ,  Shih-Fu Chang ,  John R. Smith ,  Chung-sheng Li

IPC分类号： G06F17/30

CPC分类号： G06F17/30604 ,  G06F17/30017 ,  G06F17/30858 ,  Y10S707/913 ,  Y10S707/914 ,  Y10S707/916 ,  Y10S707/99945

摘要： An invention for generating standard description records from multimedia information. The invention utilizes fundamental entity-relation models for the Generic AV DS that classify the entities, the entity attributes, and the relationships in relevant types to describe visual data. It also involves classification of entity attributes into syntactic and semantic attributes. Syntactic attributes can be categorized into different levels: type/technique, global distribution, local structure, and global composition. Semantic attributes can be likewise discretely categorized: generic object, generic scene, specific object, specific scene, abstract object, and abstract scene. The invention further classifies entity relationships into syntactic/semantic categories. Syntactic relationship categories include spatial, temporal, and visual categories. Semantic relationship categories include lexical and predicative categories. Spatial and temporal relationships can be topological or directional; visual relationships can be global, local, or composition; lexical relationships can be synonymy, antonymy, hyponymy/hypernymy, or meronymy/holonymy; and predicative relationships can be actions (events) or states.

摘要翻译： 一种用于从多媒体信息生成标准描述记录的发明。 本发明为通用AV DS使用基本实体关系模型，对实体进行分类，实体属性以及相关类型的关系来描述视觉数据。 它还涉及将实体属性分类为语法和语义属性。 语法属性可以分为不同的层次：类型/技术，全局分布，局部结构和全局组成。 语义属性可以同样地离散分类：通用对象，通用场景，特定对象，特定场景，抽象对象和抽象场景。 本发明进一步将实体关系分类为语义/语义类别。 句法关系类别包括空间，时间和视觉类别。 语义关系类别包括词汇和谓词类别。 空间和时间关系可以是拓扑或方向性; 视觉关系可以是全局，本地或组合; 词汇关系可以是同义词，antonymy，hyponymy / hypernymy，或meronymy / holonymy; 而谓词关系可以是行为（事件）或状态。

公开(公告)号：US06915239B2

公开(公告)日：2005-07-05

申请号：US10047854

申请日：2002-01-16

申请人： Lawrence D. Bergman ,  Yuan-Chi Chang ,  Matthew Leon Hill ,  Chung-Sheng Li ,  John R. Smith

发明人： Lawrence D. Bergman ,  Yuan-Chi Chang ,  Matthew Leon Hill ,  Chung-Sheng Li ,  John R. Smith

IPC分类号： G01S7/00 ,  G06F17/30 ,  H04L29/08 ,  H04Q9/00

CPC分类号： H04L67/10 ,  G01S7/003 ,  H04L67/12 ,  H04L67/125 ,  H04L69/329

摘要： Described is a method and apparatus for obtaining accurate, timely information for event detection and prediction based on autonomous opportunism. The objective is to make the best possible use of all available resources at the time of acquisition, including historical data, multiple sensors, and multiresolution acquisition capabilities, under a given set of processing and communication bandwidth constraints. This method (and the corresponding apparatus) fuses multiple adaptively acquired data sources to prepare information for use by decision support models. The onboard data acquisition schedule is constructed to maximize the prediction accuracy of the decision models, which are designed to operate progressively, utilizing data representations consisting of multiple abstraction levels and multiple resolutions. Due to the progressive nature of these models, they can be executed onboard even with the use of substantially summarized (or compressed) datasets delivered from the ground or from other satellite platforms. Models are formulated to accept data with less than complete certainty, thus allowing real-time decisions to be made on locations where additional data is to be acquired based on predicted likelihood of the event of interest and uncertainties. Multi-abstraction-level multi-resolution data is expressed using standard-compliant representations, and progressively transmitted to the ground or other platforms. More detailed calculations can then be performed on the ground using all of the available real time and historical data.

摘要翻译： 描述了一种用于基于自主机会主义获得准确，及时的事件检测和预测信息的方法和装置。 目标是在给定的一组处理和通信带宽约束下，在获取时尽可能最好地利用所有可用资源，包括历史数据，多个传感器和多分辨率获取功能。 该方法（和相应的装置）融合多个自适应采集的数据源，以准备供决策支持模型使用的信息。 构建车载数据采集计划，以最大化决策模型的预测精度，其被设计为逐步运行，利用由多个抽象级别和多个分辨率组成的数据表示。 由于这些模型的渐进性，即使使用从地面或其他卫星平台传送的基本总结（或压缩）数据集，它们也可以在船上执行。 模型被制定为接受不完全确定性的数据，从而允许根据预期的兴趣事件和不确定性的可能性来获取附加数据的位置进行实时决策。 多抽象级多分辨率数据使用符合标准的表示法表示，并逐渐传输到地面或其他平台。 然后可以使用所有可用的实时和历史数据在地面上执行更详细的计算。

公开(公告)号：US06697818B2

公开(公告)日：2004-02-24

申请号：US09881265

申请日：2001-06-14

申请人： Chung-Sheng Li ,  John R. Smith ,  Yuan-Chi Chang ,  Anant D. Jhingran ,  Sriram K. Padmanabhan ,  Hui-I Hsiao ,  David Mun-Hien Choy ,  Jy-Jine James Lin ,  Gene Y. C. Fuh ,  Robin Williams ,  Lawrence D. Bergman

发明人： Chung-Sheng Li ,  John R. Smith ,  Yuan-Chi Chang ,  Anant D. Jhingran ,  Sriram K. Padmanabhan ,  Hui-I Hsiao ,  David Mun-Hien Choy ,  Jy-Jine James Lin ,  Gene Y. C. Fuh ,  Robin Williams ,  Lawrence D. Bergman

IPC分类号： G06F1730

CPC分类号： G06F17/30595 ,  G06F17/30607 ,  Y10S707/99943 ,  Y10S707/99944

摘要： Methods and apparatus for providing a multi-tier object-relational database architecture are disclosed. In one illustrative embodiment of the present invention, a multi-tier database architecture comprises an object-relational database engine as a top tier, one or more domain-specific extension modules as a bottom tier, and one or more universal extension modules as a middle tier. The individual extension modules of the bottom tier operationally connect with the one or more universal extension modules which, themselves, operationally connect with the database engine. The domain-specific extension modules preferably provide such functions as search, index, and retrieval services of images, video, audio, time series, web pages, text, XML, spatial data, etc. The domain-specific extension modules may include one or more IBM DB2 extenders, Oracle data cartridges and/or Informix datablades, although other domain-specific extension modules may be used.

摘要翻译： 公开了提供多层对象 - 关系数据库架构的方法和装置。 在本发明的一个说明性实施例中，多层数据库架构包括作为顶层的对象关系数据库引擎，作为底层的一个或多个域专用扩展模块和作为中间层的一个或多个通用扩展模块 层。 底层的各个扩展模块与一个或多个通用扩展模块操作连接，该扩展模块本身与数据库引擎可操作地连接。 域特定扩展模块优选地提供诸如图像，视频，音频，时间序列，网页，文本，XML，空间数据等的搜索，索引和检索服务的功能。特定领域的扩展模块可以包括一个或 更多的IBM DB2扩展器，Oracle数据盒式磁带和/或Informix数据库，尽管可以使用其他域特定的扩展模块。

公开(公告)号：US06941325B1

公开(公告)日：2005-09-06

申请号：US09889859

申请日：2000-02-01

申请人： Ana B. Benitez ,  Alejandro Jaimes ,  Paek Seungyup ,  Shih-Fu Chang ,  Chung-Sheng Li ,  John R. Smith

发明人： Ana B. Benitez ,  Alejandro Jaimes ,  Paek Seungyup ,  Shih-Fu Chang ,  Chung-Sheng Li ,  John R. Smith

IPC分类号： G06F17/30

CPC分类号： G06F17/3002 ,  Y10S707/99944 ,  Y10S707/99945

摘要： A multimedia archive description scheme is provided for characterizing a multimedia archive having records and associated record descriptions. The multimedia archive description scheme provides a data structure which relates records by similarity measures. The principle data structure in the multimedia archive description scheme is a cluster. A cluster includes one or more attributes of the records in the archive and can include one or more cluster relationships. Cluster attributes can include feature space attributes, semantic attributes, media attributes and meta attributes of the records in the archive. The cluster relationships can relate records to clusters or clusters to clusters. Cluster relationships can include feature space (syntactic) relationships, semantic relationships, media relationships and meta relationships. The multimedia archive description scheme provides an efficient form for describing a collection of records.

摘要翻译： 提供了多媒体档案描述方案，用于表征具有记录和相关联的记录描述的多媒体档案。 多媒体档案描述方案提供了一种通过相似度测量来记录记录的数据结构。 多媒体档案描述方案中的原理数据结构是一个集群。 集群包括归档中记录的一个或多个属性，并且可以包括一个或多个集群关系。 集群属性可以包括存档中的记录的特征空间属性，语义属性，媒体属性和元属性。 集群关系可以将记录与集群或集群关联到集群。 群集关系可以包括特征空间（句法）关系，语义关系，媒体关系和元关系。 多媒体档案描述方案提供了一种用于描述记录集合的有效形式。

公开(公告)号：US07818329B2

公开(公告)日：2010-10-19

申请号：US11759654

申请日：2007-06-07

申请人： Murray S. Campbell ,  Shahram Ebadollahi ,  Matthew L. Hill ,  Brian Michael Landry ,  Chung-Sheng Li ,  Apostol Ivanov Natsev ,  Milind R. Naphade ,  John R. Smith ,  Jelena Tesic ,  Lexing Xie

发明人： Murray S. Campbell ,  Shahram Ebadollahi ,  Matthew L. Hill ,  Brian Michael Landry ,  Chung-Sheng Li ,  Apostol Ivanov Natsev ,  Milind R. Naphade ,  John R. Smith ,  Jelena Tesic ,  Lexing Xie

IPC分类号： G06F17/30

CPC分类号： G06F17/30056 ,  G06F17/30038 ,  Y10S707/99934

摘要： A method and apparatus is disclosed that receives an input narrative in a particular media format, and produces therefrom a multimedia enriched version of the input narrative. In one embodiment, a method is provided for enriching an input narrative with multimedia content, wherein the method includes the step of selectively segmenting the input narrative to form queries pertaining to different portions or elements of the input narrative. The method further comprises retrieving multimedia artifacts from one or more multimedia repositories, wherein each retrieved multimedia artifact is associated with one of the queries, and selecting a subset of the retrieved multimedia artifacts, wherein the subset includes artifacts comprising different types of multimedia content. The input narrative is then combined with respective multimedia artifacts of the subset, in order to provide an enriched and enhanced narrative.

摘要翻译： 公开了一种以特定媒体格式接收输入叙述的方法和装置，并从其产生输入叙述的多媒体增强版本。 在一个实施例中，提供了一种用于利用多媒体内容丰富输入叙事的方法，其中所述方法包括选择性地分割输入叙述以形成关于输入叙述的不同部分或元素的查询的步骤。 该方法还包括从一个或多个多媒体存储库检索多媒体伪影，其中每个检索到的多媒体伪影与查询中的一个相关联，并且选择检索到的多媒体伪影的子集，其中该子集包括包含不同类型的多媒体内容的伪影。 然后将输入叙述与该子集的相应多媒体工件组合，以便提供丰富和增强的叙事。

公开(公告)号：US07401062B2

公开(公告)日：2008-07-15

申请号：US11451972

申请日：2006-06-13

申请人： Chung-Sheng Li ,  Ching-Yung Lin ,  Milind R. Naphade ,  John R. Smith

发明人： Chung-Sheng Li ,  Ching-Yung Lin ,  Milind R. Naphade ,  John R. Smith

IPC分类号： G06F17/00 ,  G06F15/18 ,  G06N5/02

CPC分类号： G06F9/50 ,  G06N99/005

摘要： Methods and apparatus for optimizing resource allocation among data analysis functions in a classification system are provided. Each of the data analysis functions is characterized as a set of operating points in accordance with at least one of resource requirements and analysis quality. An operating point for each of the data analysis functions is selected in accordance with one or more constraints. The analysis functions are applied at selected operating points to optimize resource allocation among the data analysis functions in the classification system.

摘要翻译： 提供了一种用于优化分类系统中数据分析功能之间的资源分配的方法和装置。 根据资源需求和分析质量中的至少一个，每个数据分析功能被表征为一组操作点。 根据一个或多个约束来选择每个数据分析功能的操作点。 分析功能应用于所选择的操作点，以优化分类系统中数据分析功能之间的资源分配。