公开(公告)号：US07143434B1

公开(公告)日：2006-11-28

申请号：US09831218

申请日：1999-11-05

申请人： Seungyup Paek ,  Ana Benitez ,  Shih-Fu Chang ,  Atul Puri ,  Chung-Sheng Li ,  John R. Smith ,  Lawrence Bergman

发明人： Seungyup Paek ,  Ana Benitez ,  Shih-Fu Chang ,  Atul Puri ,  Chung-Sheng Li ,  John R. Smith ,  Lawrence Bergman

IPC分类号： G09G5/00 ,  H04B1/66 ,  G06K9/00

CPC分类号： G06K9/00711 ,  G06F17/30858 ,  G06K9/468

摘要： The present invention relates to a system for generating a description record from multimedia information including, e.g., video data. A multimedia information input interface is used to receive multimedia information. A computer processor receives the multimedia information, processes the video information by performing video object extraction processing to generate video object descriptions from the video information, processes the generated video object descriptions by object hierarchy construction and extraction processing to generate video object hierarchy descriptions, and processes the generated video object descriptions by entity relation graph descriptions.

摘要翻译： 本发明涉及一种用于从包括例如视频数据的多媒体信息产生描述记录的系统。 多媒体信息输入接口用于接收多媒体信息。 计算机处理器接收多媒体信息，通过执行视频对象提取处理来处理视频信息以从视频信息生成视频对象描述，通过对象层次结构和提取处理处理所生成的视频对象描述以产生视频对象层级描述，以及处理 通过实体关系图描述生成的视频对象描述。

公开(公告)号：US08370869B2

公开(公告)日：2013-02-05

申请号：US11448114

申请日：2006-06-06

申请人： Seungyup Paek ,  Ana Benitez ,  Shih-Fu Chang ,  Atul Puri ,  Qian Huang ,  Chung-Sheng Li ,  John R. Smith ,  Lawrence Bergman

发明人： Seungyup Paek ,  Ana Benitez ,  Shih-Fu Chang ,  Atul Puri ,  Qian Huang ,  Chung-Sheng Li ,  John R. Smith ,  Lawrence Bergman

IPC分类号： H04H60/32 ,  G06K9/00

CPC分类号： G06K9/00711 ,  G06F17/30858 ,  G06K9/468

摘要： Systems and methods for describing video content establish video description records which include an object set (24), an object hierarchy (26) and entity relation graphs (28). Video objects can include global objects, segment objects and local objects. The video objects are further defined by a number of features organized in classes, which in turn are further defined by a number of feature descriptors (36, 38, and 40). The relationships (44) between and among the objects in the object set (24) are defined by the object hierarchy (26) and entity relation graphs (28). The video description records provide a standard vehicle for describing the content and context of video information for subsequent access and processing by computer applications such as search engines, filters and archive systems.

摘要翻译： 用于描述视频内容的系统和方法建立包括对象集（24），对象层次（26）和实体关系图（28）的视频描述记录。 视频对象可以包括全局对象，段对象和本地对象。 视频对象由类别中组织的多个特征进一步限定，这些特征又由多个特征描述符（36,38和40）进一步限定。 对象集合（24）中的对象之间和之间的关系（44）由对象层次结构（26）和实体关系图（28）定义。 视频描述记录提供用于描述视频信息的内容和上下文的标准车辆，以便随后通过计算机应用（例如搜索引擎，过滤器和归档系统）进行访问和处理。

公开(公告)号：US20070245400A1

公开(公告)日：2007-10-18

申请号：US11448114

申请日：2006-06-06

申请人： Seungyup Paek ,  Ana Benitez ,  Shih-Fu Chang ,  Atul Puri ,  Qian Huang ,  Chung-Sheng Li ,  John Smith ,  Lawrence Bergman

发明人： Seungyup Paek ,  Ana Benitez ,  Shih-Fu Chang ,  Atul Puri ,  Qian Huang ,  Chung-Sheng Li ,  John Smith ,  Lawrence Bergman

IPC分类号： H04N7/16

CPC分类号： G06K9/00711 ,  G06F17/30858 ,  G06K9/468

摘要： Systems and methods for describing video content establish video description records which include an object set (24), an object hierarchy (26) and entity relation graphs (28). Video objects can include global objects, segment objects and local objects. The video objects are further defined by a number of features organized in classes, which in turn are further defined by a number of feature descriptors (36, 38, and 40). The relationships (44) between and among the objects in the object set (24) are defined by the object hierarchy (26) and entity relation graphs (28). The video description records provide a standard vehicle for describing the content and context of video information for subsequent access and processing by computer applications such as search engines, filters and archive systems.

摘要翻译： 用于描述视频内容的系统和方法建立包括对象集（24），对象层次（26）和实体关系图（28）的视频描述记录。 视频对象可以包括全局对象，段对象和本地对象。 视频对象由类别中组织的多个特征进一步限定，这些特征又由多个特征描述符（36,38和40）进一步限定。 对象集合（24）中的对象之间和之间的关系（44）由对象层次结构（26）和实体关系图（28）定义。 视频描述记录提供用于描述视频信息的内容和上下文的标准车辆，以便随后通过计算机应用（例如搜索引擎，过滤器和归档系统）进行访问和处理。

公开(公告)号：US07599965B1

公开(公告)日：2009-10-06

申请号：US11616315

申请日：2006-12-27

申请人： Ana Benitez ,  Shih-Fu Chang ,  Qian Huang ,  Seungyup Paek ,  Atul Puri

发明人： Ana Benitez ,  Shih-Fu Chang ,  Qian Huang ,  Seungyup Paek ,  Atul Puri

IPC分类号： G06F17/30

CPC分类号： G06F17/30044 ,  G06F17/3002 ,  G06F17/30038 ,  G06F17/30858 ,  G06F17/30914 ,  G06F17/30958 ,  Y10S707/99945 ,  Y10S707/99948

摘要： The invention provides a system and method for integrating multimedia descriptions in a way that allows humans, software components or devices to easily identify, represent, manage, retrieve, and categorize the multimedia content. In this manner, a user who may be interested in locating a specific piece of multimedia content from a database, Internet, or broadcast media, for example, may search for and find the multimedia content. In this regard, the invention provides a system and method that receives multimedia content and separates the multimedia content into separate components which are assigned to multimedia categories, such as image, video, audio, synthetic and text. Within each of the multimedia categories, the multimedia content is classified and descriptions of the multimedia content are generated. The descriptions are then formatted, integrated, using a multimedia integration description scheme, and the multimedia integration description is generated for the multimedia content. The multimedia description is then stored into a database. As a result, a user may query a search engine which then retrieves the multimedia content from the database whose integration description matches the query criteria specified by the user. The search engine can then provide the user a useful search result based on the multimedia integration description.

公开(公告)号：US07809760B2

公开(公告)日：2010-10-05

申请号：US12559817

申请日：2009-09-15

申请人： Ana Benitez ,  Shih-Fu Chang ,  Qian Huang ,  Seungyup Paek ,  Atul Puri

发明人： Ana Benitez ,  Shih-Fu Chang ,  Qian Huang ,  Seungyup Paek ,  Atul Puri

IPC分类号： G06F17/30

CPC分类号： G06F17/30044 ,  G06F17/3002 ,  G06F17/30038 ,  G06F17/30858 ,  G06F17/30914 ,  G06F17/30958 ,  Y10S707/99945 ,  Y10S707/99948

摘要： The invention provides a system and method for integrating multimedia descriptions in a way that allows humans, software components or devices to easily identify, represent, manage, retrieve, and categorize the multimedia content. In this manner, a user who may be interested in locating a specific piece of multimedia content from a database, Internet, or broadcast media, for example, may search for and find the multimedia content. In this regard, the invention provides a system and method that receives multimedia content and separates the multimedia content into separate components which are assigned to multimedia categories, such as image, video, audio, synthetic and text. Within each of the multimedia categories, the multimedia content is classified and descriptions of the multimedia content are generated. The descriptions are then formatted, integrated, using a multimedia integration description scheme, and the multimedia integration description is generated for the multimedia content. The multimedia description is then stored into a database. As a result, a user may query a search engine which then retrieves the multimedia content from the database whose integration description matches the query criteria specified by the user. The search engine can then provide the user a useful search result based on the multimedia integration description.

摘要翻译： 本发明提供一种用于以允许人，软件组件或设备容易地识别，表示，管理，检索和分类多媒体内容的方式来集成多媒体描述的系统和方法。 以这种方式，例如，可能有兴趣从数据库，因特网或广播媒体定位特定的多媒体内容的用户可以搜索和查找多媒体内容。 在这方面，本发明提供了一种接收多媒体内容并将多媒体内容分离成分配给多媒体类别（诸如图像，视频，音频，合成和文本）的组件的系统和方法。 在多媒体类别的每一个内，对多媒体内容进行分类，并且生成多媒体内容的描述。 然后使用多媒体集成描述方案对所述描述进行格式化，集成化，并且为多媒体内容生成多媒体集成描述。 然后将多媒体描述存储到数据库中。 结果，用户可以查询搜索引擎，该搜索引擎然后从整合描述与用户指定的查询标准匹配的数据库中检索多媒体内容。 然后，搜索引擎可以基于多媒体整合描述向用户提供有用的搜索结果。

公开(公告)号：US20060167876A1

公开(公告)日：2006-07-27

申请号：US11278671

申请日：2006-04-04

申请人： Ana Benitez ,  Shih-Fu Chang ,  Qian Huang ,  Seungyup Paek ,  Atul Puri

发明人： Ana Benitez ,  Shih-Fu Chang ,  Qian Huang ,  Seungyup Paek ,  Atul Puri

IPC分类号： G06F7/00 ,  G06F17/30 ,  G06F17/21

CPC分类号： G06F17/30044 ,  G06F17/3002 ,  G06F17/30038 ,  G06F17/30858 ,  G06F17/30914 ,  G06F17/30958 ,  Y10S707/99945 ,  Y10S707/99948

摘要： The invention provides a system and method for integrating multimedia descriptions in a way that allows humans, software components or devices to easily identify, represent, manage, retrieve, and categorize the multimedia content. In this manner, a user who may be interested in locating a specific piece of multimedia content from a database, Internet, or broadcast media, for example, may search for and find the multimedia content. In this regard, the invention provides a system and method that receives multimedia content and separates the multimedia content into separate components which are assigned to multimedia categories, such as image, video, audio, synthetic and text. Within each of the multimedia categories, the multimedia content is classified and descriptions of the multimedia content are generated. The descriptions are then formatted, integrated, using a multimedia integration description scheme, and the multimedia integration description is generated for the multimedia content. The multimedia description is then stored into a database. As a result, a user may query a search engine which then retrieves the multimedia content from the database whose integration description matches the query criteria specified by the user. The search engine can then provide the user a useful search result based on the multimedia integration description.

摘要翻译： 本发明提供一种用于以允许人，软件组件或设备容易地识别，表示，管理，检索和分类多媒体内容的方式来集成多媒体描述的系统和方法。 以这种方式，例如，可能有兴趣从数据库，因特网或广播媒体定位特定的多媒体内容的用户可以搜索和查找多媒体内容。 在这方面，本发明提供了一种接收多媒体内容并将多媒体内容分离成分配给多媒体类别（诸如图像，视频，音频，合成和文本）的组件的系统和方法。 在多媒体类别的每一个内，对多媒体内容进行分类，并且生成多媒体内容的描述。 然后使用多媒体集成描述方案对所述描述进行格式化，集成化，并且为多媒体内容生成多媒体集成描述。 然后将多媒体描述存储到数据库中。 结果，用户可以查询搜索引擎，该搜索引擎然后从整合描述与用户指定的查询标准匹配的数据库中检索多媒体内容。 然后，搜索引擎可以基于多媒体整合描述向用户提供有用的搜索结果。

公开(公告)号：US07506024B2

公开(公告)日：2009-03-17

申请号：US11278671

申请日：2006-04-04

申请人： Ana Benitez ,  Shih-Fu Chang ,  Qian Huang ,  Seungyup Paek ,  Atul Puri

发明人： Ana Benitez ,  Shih-Fu Chang ,  Qian Huang ,  Seungyup Paek ,  Atul Puri

IPC分类号： G06F15/16 ,  G06F12/00

CPC分类号： G06F17/30044 ,  G06F17/3002 ,  G06F17/30038 ,  G06F17/30858 ,  G06F17/30914 ,  G06F17/30958 ,  Y10S707/99945 ,  Y10S707/99948

摘要： The invention provides a system and method for integrating multimedia descriptions in a way that allows humans, software components or devices to easily identify, represent, manage, retrieve, and categorize the multimedia content. In this manner, a user who may be interested in locating a specific piece of multimedia content from a database, Internet, or broadcast media, for example, may search for and find the multimedia content. In this regard, the invention provides a system and method that receives multimedia content and separates the multimedia content into separate components which are assigned to multimedia categories, such as image, video, audio, synthetic and text. Within each of the multimedia categories, the multimedia content is classified and descriptions of the multimedia content are generated. The descriptions are then formatted, integrated, using a multimedia integration description scheme, and the multimedia integration description is generated for the multimedia content. The multimedia description is then stored into a database. As a result, a user may query a search engine which then retrieves the multimedia content from the database whose integration description matches the query criteria specified by the user. The search engine can then provide the user a useful search result based on the multimedia integration description.

摘要翻译： 本发明提供一种用于以允许人，软件组件或设备容易地识别，表示，管理，检索和分类多媒体内容的方式来集成多媒体描述的系统和方法。 以这种方式，例如，可能有兴趣从数据库，因特网或广播媒体定位特定的多媒体内容的用户可以搜索和查找多媒体内容。 在这方面，本发明提供了一种接收多媒体内容并将多媒体内容分离成分配给多媒体类别（诸如图像，视频，音频，合成和文本）的组件的系统和方法。 在多媒体类别的每一个内，对多媒体内容进行分类，并且生成多媒体内容的描述。 然后使用多媒体集成描述方案对所述描述进行格式化，集成化，并且为多媒体内容生成多媒体集成描述。 然后将多媒体描述存储到数据库中。 结果，用户可以查询搜索引擎，该搜索引擎然后从整合描述与用户指定的查询标准匹配的数据库中检索多媒体内容。 然后，搜索引擎可以基于多媒体整合描述向用户提供有用的搜索结果。

公开(公告)号：US09239877B2

公开(公告)日：2016-01-19

申请号：US13169330

申请日：2011-06-27

申请人： Ana Belen Benitez ,  Shih-Fu Chang ,  Qian Huang ,  Seungyup Paek ,  Atul Puri

发明人： Ana Belen Benitez ,  Shih-Fu Chang ,  Qian Huang ,  Seungyup Paek ,  Atul Puri

IPC分类号： G06F17/30

CPC分类号： G06F17/30044 ,  G06F17/3002 ,  G06F17/30038 ,  G06F17/30858 ,  G06F17/30914 ,  G06F17/30958 ,  Y10S707/99945 ,  Y10S707/99948

摘要： The invention provides a system and method for integrating multimedia descriptions in a way that allows humans, software components or devices to easily identify, represent, manage, retrieve, and categorize the multimedia content. In this manner, a user who may be interested in locating a specific piece of multimedia content from a database, Internet, or broadcast media, for example, may search for and find the multimedia content. In this regard, the invention provides a system and method that receives multimedia content and separates the multimedia content into separate components which are assigned to multimedia categories, such as image, video, audio, synthetic and text. Within each of the multimedia categories, the multimedia content is classified and descriptions of the multimedia content are generated. The descriptions are then formatted, integrated, using a multimedia integration description scheme, and the multimedia integration description is generated for the multimedia content. The multimedia description is then stored into a database. As a result, a user may query a search engine which then retrieves the multimedia content from the database whose integration description matches the query criteria specified by the user. The search engine can then provide the user a useful search result based on the multimedia integration description.

公开(公告)号：US20090157736A1

公开(公告)日：2009-06-18

申请号：US12372052

申请日：2009-02-17

申请人： Ana Belen Benitez ,  Shih-Fu Chang ,  Qian Huang ,  Seungyup Paek ,  Atul Puri

发明人： Ana Belen Benitez ,  Shih-Fu Chang ,  Qian Huang ,  Seungyup Paek ,  Atul Puri

IPC分类号： G06F17/30 ,  G06F15/16

CPC分类号： G06F17/30044 ,  G06F17/3002 ,  G06F17/30038 ,  G06F17/30858 ,  G06F17/30914 ,  G06F17/30958 ,  Y10S707/99945 ,  Y10S707/99948

摘要： The invention provides a system and method for integrating multimedia descriptions in a way that allows humans, software components or devices to easily identify, represent, manage, retrieve, and categorize the multimedia content. In this manner, a user who may be interested in locating a specific piece of multimedia content from a database, Internet, or broadcast media, for example, may search for and find the multimedia content. In this regard, the invention provides a system and method that receives multimedia content and separates the multimedia content into separate components which are assigned to multimedia categories, such as image, video, audio, synthetic and text. Within each of the multimedia categories, the multimedia content is classified and descriptions of the multimedia content are generated. The descriptions are then formatted, integrated, using a multimedia integration description scheme, and the multimedia integration description is generated for the multimedia content. The multimedia description is then stored into a database. As a result, a user may query a search engine which then retrieves the multimedia content from the database whose integration description matches the query criteria specified by the user. The search engine can then provide the user a useful search result based on the multimedia integration description.

摘要翻译： 本发明提供一种用于以允许人，软件组件或设备容易地识别，表示，管理，检索和分类多媒体内容的方式来集成多媒体描述的系统和方法。 以这种方式，例如，可能有兴趣从数据库，因特网或广播媒体定位特定的多媒体内容的用户可以搜索和查找多媒体内容。 在这方面，本发明提供了一种接收多媒体内容并将多媒体内容分离成分配给多媒体类别（诸如图像，视频，音频，合成和文本）的组件的系统和方法。 在多媒体类别的每一个内，对多媒体内容进行分类，并且生成多媒体内容的描述。 然后使用多媒体集成描述方案对所述描述进行格式化，集成化，并且为多媒体内容生成多媒体集成描述。 然后将多媒体描述存储到数据库中。 结果，用户可以查询搜索引擎，该搜索引擎然后从整合描述与用户指定的查询标准匹配的数据库中检索多媒体内容。 然后，搜索引擎可以基于多媒体整合描述向用户提供有用的搜索结果。

公开(公告)号：US20110258189A1

公开(公告)日：2011-10-20

申请号：US13169330

申请日：2011-06-27

申请人： Ana Belen Benitez ,  Shih-Fu Chang ,  Qian Huang ,  Seungyup Paek ,  Atul Puri

发明人： Ana Belen Benitez ,  Shih-Fu Chang ,  Qian Huang ,  Seungyup Paek ,  Atul Puri

IPC分类号： G06F17/30

CPC分类号： G06F17/30044 ,  G06F17/3002 ,  G06F17/30038 ,  G06F17/30858 ,  G06F17/30914 ,  G06F17/30958 ,  Y10S707/99945 ,  Y10S707/99948

摘要： The invention provides a system and method for integrating multimedia descriptions in a way that allows humans, software components or devices to easily identify, represent, manage, retrieve, and categorize the multimedia content. In this manner, a user who may be interested in locating a specific piece of multimedia content from a database, Internet, or broadcast media, for example, may search for and find the multimedia content. In this regard, the invention provides a system and method that receives multimedia content and separates the multimedia content into separate components which are assigned to multimedia categories, such as image, video, audio, synthetic and text. Within each of the multimedia categories, the multimedia content is classified and descriptions of the multimedia content are generated. The descriptions are then formatted, integrated, using a multimedia integration description scheme, and the multimedia integration description is generated for the multimedia content. The multimedia description is then stored into a database. As a result, a user may query a search engine which then retrieves the multimedia content from the database whose integration description matches the query criteria specified by the user. The search engine can then provide the user a useful search result based on the multimedia integration description.

摘要翻译： 本发明提供一种用于以允许人，软件组件或设备容易地识别，表示，管理，检索和分类多媒体内容的方式来集成多媒体描述的系统和方法。 以这种方式，例如，可能有兴趣从数据库，因特网或广播媒体定位特定的多媒体内容的用户可以搜索和查找多媒体内容。 在这方面，本发明提供了一种接收多媒体内容并将多媒体内容分离成分配给多媒体类别（诸如图像，视频，音频，合成和文本）的组件的系统和方法。 在多媒体类别的每一个内，对多媒体内容进行分类，并且生成多媒体内容的描述。 然后使用多媒体集成描述方案对所述描述进行格式化，集成化，并且为多媒体内容生成多媒体集成描述。 然后将多媒体描述存储到数据库中。 结果，用户可以查询搜索引擎，该搜索引擎然后从整合描述与用户指定的查询标准匹配的数据库中检索多媒体内容。 然后，搜索引擎可以基于多媒体整合描述向用户提供有用的搜索结果。