Method and apparatus for query expansion based on multimodal cross-vocabulary mapping
    1.
    发明授权
    Method and apparatus for query expansion based on multimodal cross-vocabulary mapping 有权
    基于多模式跨词汇映射的查询扩展方法和装置

    公开(公告)号:US07788099B2

    公开(公告)日:2010-08-31

    申请号:US11733033

    申请日:2007-04-09

    IPC分类号: G10L21/00

    CPC分类号: G06F17/30038 G06F17/30023

    摘要: A computer implemented method, apparatus, and computer usable program code for multimodal cross-vocabulary mapping. A corpus of multimodal content is annotated simultaneously using annotations from a plurality of vocabularies to form a set of common annotations. Relationships between a first vocabulary associated with a first modality and a second vocabulary associated with a second modality are identified using the set of common annotations to form a multimodal vocabulary mapping. Items in the first vocabulary associated with the first modality are mapped to items in the second vocabulary associated with the second modality using the multimodal vocabulary mapping.

    摘要翻译: 用于多模式跨词汇映射的计算机实现的方法,装置和计算机可用的程序代码。 使用来自多个词汇表的注释同时注释多模态内容的语料库以形成一组通用注释。 与第一模态相关联的第一词汇与与第二模态相关联的第二词汇表之间的关系使用该组公共注释来标识以形成多模态词汇映射。 与第一模态相关联的第一词汇中的项目使用多模态词汇映射被映射到与第二模态相关联的第二词汇表中的项目。

    METHOD AND APPARATUS FOR QUERY EXPANSION BASED ON MULTIMODAL CROSS-VOCABULARY MAPPING
    2.
    发明申请
    METHOD AND APPARATUS FOR QUERY EXPANSION BASED ON MULTIMODAL CROSS-VOCABULARY MAPPING 有权
    基于多模式交叉映射查询扩展的方法和装置

    公开(公告)号:US20080250011A1

    公开(公告)日:2008-10-09

    申请号:US11733033

    申请日:2007-04-09

    IPC分类号: G06F7/00

    CPC分类号: G06F17/30038 G06F17/30023

    摘要: A computer implemented method, apparatus, and computer usable program code for multimodal cross-vocabulary mapping. A corpus of multimodal content is annotated simultaneously using annotations from a plurality of vocabularies to form a set of common annotations. Relationships between a first vocabulary associated with a first modality and a second vocabulary associated with a second modality are identified using the set of common annotations to form a multimodal vocabulary mapping. Items in the first vocabulary associated with the first modality are mapped to items in the second vocabulary associated with the second modality using the multimodal vocabulary mapping.

    摘要翻译: 用于多模式跨词汇映射的计算机实现的方法,装置和计算机可用程序代码。 使用来自多个词汇表的注释同时注释多模态内容的语料库以形成一组通用注释。 与第一模态相关联的第一词汇与与第二模态相关联的第二词汇表之间的关系使用该组公共注释来标识以形成多模态词汇映射。 与第一模态相关联的第一词汇中的项目使用多模态词汇映射被映射到与第二模态相关联的第二词汇表中的项目。

    Method and apparatus for automatic multimedia narrative enrichment
    3.
    发明授权
    Method and apparatus for automatic multimedia narrative enrichment 有权
    自动多媒体叙事丰富的方法和装置

    公开(公告)号:US07818329B2

    公开(公告)日:2010-10-19

    申请号:US11759654

    申请日:2007-06-07

    IPC分类号: G06F17/30

    摘要: A method and apparatus is disclosed that receives an input narrative in a particular media format, and produces therefrom a multimedia enriched version of the input narrative. In one embodiment, a method is provided for enriching an input narrative with multimedia content, wherein the method includes the step of selectively segmenting the input narrative to form queries pertaining to different portions or elements of the input narrative. The method further comprises retrieving multimedia artifacts from one or more multimedia repositories, wherein each retrieved multimedia artifact is associated with one of the queries, and selecting a subset of the retrieved multimedia artifacts, wherein the subset includes artifacts comprising different types of multimedia content. The input narrative is then combined with respective multimedia artifacts of the subset, in order to provide an enriched and enhanced narrative.

    摘要翻译: 公开了一种以特定媒体格式接收输入叙述的方法和装置,并从其产生输入叙述的多媒体增强版本。 在一个实施例中,提供了一种用于利用多媒体内容丰富输入叙事的方法,其中所述方法包括选择性地分割输入叙述以形成关于输入叙述的不同部分或元素的查询的步骤。 该方法还包括从一个或多个多媒体存储库检索多媒体伪影,其中每个检索到的多媒体伪影与查询中的一个相关联,并且选择检索到的多媒体伪影的子集,其中该子集包括包含不同类型的多媒体内容的伪影。 然后将输入叙述与该子集的相应多媒体工件组合,以便提供丰富和增强的叙事。

    METHOD AND APPARATUS FOR AUTOMATIC MULTIMEDIA NARRATIVE ENRICHMENT
    4.
    发明申请
    METHOD AND APPARATUS FOR AUTOMATIC MULTIMEDIA NARRATIVE ENRICHMENT 有权
    自动多媒体复制方法与装置

    公开(公告)号:US20080306925A1

    公开(公告)日:2008-12-11

    申请号:US11759654

    申请日:2007-06-07

    IPC分类号: G06F17/30

    摘要: A method and apparatus is disclosed that receives an input narrative in a particular media format, and produces therefrom a multimedia enriched version of the input narrative. In one embodiment, a method is provided for enriching an input narrative with multimedia content, wherein the method includes the step of selectively segmenting the input narrative to form queries pertaining to different portions or elements of the input narrative. The method further comprises retrieving multimedia artifacts from one or more multimedia repositories, wherein each retrieved multimedia artifact is associated with one of the queries, and selecting a subset of the retrieved multimedia artifacts, wherein the subset includes artifacts comprising different types of multimedia content. The input narrative is then combined with respective multimedia artifacts of the subset, in order to provide an enriched and enhanced narrative.

    摘要翻译: 公开了一种以特定媒体格式接收输入叙述的方法和装置,并从其产生输入叙述的多媒体增强版本。 在一个实施例中,提供了一种用于利用多媒体内容丰富输入叙事的方法,其中所述方法包括选择性地分割输入叙述以形成关于输入叙述的不同部分或元素的查询的步骤。 该方法还包括从一个或多个多媒体存储库检索多媒体伪影,其中每个检索到的多媒体伪影与查询中的一个相关联,并且选择检索到的多媒体伪像的子集,其中该子集包括包含不同类型的多媒体内容的伪影。 然后将输入叙述与该子集的相应多媒体工件组合,以便提供丰富和增强的叙事。

    Method and apparatus for semantic assisted rating of multimedia content
    6.
    发明授权
    Method and apparatus for semantic assisted rating of multimedia content 有权
    多媒体内容语义辅助评估方法与装置

    公开(公告)号:US08032539B2

    公开(公告)日:2011-10-04

    申请号:US12046206

    申请日:2008-03-11

    IPC分类号: G06F17/30

    摘要: The present invention is directed to a method and apparatus for assisting in rating and filtering multimedia content, such as images, videos and sound recordings. One embodiment comprises a computer implemented method for rating the objectionability of specified digital content that comprises one or more discrete content items, wherein the method includes the step of moving the specified content to one or more filtering stages in a succession of filtering stages. After the specified content is moved to a given one of the filtering stages, a rating procedure is carried out to determine whether a rating can be applied to one or more of the content items, and if so, a selected rating is applied to each of the one or more content items. The method further comprises moving content items of the specified content to the next stage in the succession after the given stage, when at least one content item of the specified content remains without rating, after the rating procedure at the given stage. When none of the content items of the specified content remains without a rating after the rating procedure has been completed at the given stage, ratings that have been respectively applied to at least some of the content items are selectively processed, in order to determine an overall objectionability rating for the specified content.

    摘要翻译: 本发明涉及一种用于协助评估和过滤诸如图像,视频和录音的多媒体内容的方法和装置。 一个实施例包括用于评估包括一个或多个离散内容项目的指定数字内容的不良性的计算机实现的方法,其中该方法包括将指定内容移动到一系列过滤阶段中的一个或多个过滤阶段的步骤。 在将指定内容移动到给定的一个过滤阶段之后,执行评级过程以确定评级是否可应用于一个或多个内容项,如果是,则将所选评级应用于 一个或多个内容项。 该方法还包括在给定阶段之后的指定内容的至少一个内容项目在给定阶段的评级过程之后保持没有评级的情况下,将指定内容的内容项移动到下一阶段。 当在给定阶段在评级程序完成之后,指定内容的内容项目中没有任何内容项目没有得到评级时,已经分别应用于至少一些内容项目的评级被选择性地处理,以便确定总体 指定内容的异议评级。

    Temporal segment based extraction and robust matching of video fingerprints
    7.
    发明授权
    Temporal segment based extraction and robust matching of video fingerprints 有权
    基于时间段的提取和视频指纹的鲁棒匹配

    公开(公告)号:US09177209B2

    公开(公告)日:2015-11-03

    申请号:US11958298

    申请日:2007-12-17

    IPC分类号: G06K9/00 G06F17/30

    摘要: A computer implemented method, apparatus, and computer program product code for temporal, event-based video fingerprinting. In one embodiment, events in video content are detected. The video content comprises a plurality of video frames. An event represents discrete points of interest in the video content. A set of temporal, event-based segments are generated using the events. Each temporal, event-based segment is a segment of the video content covering a set of events. A time series signal is derived from each temporal, event-based segment using temporal tracking of content-based features of a set of frames associated with the each temporal, event-based segment. A temporal segment based fingerprint is extracted based on the time series signal for the each temporal, event-based segment to form a set of temporal segment based fingerprints associated with the video content.

    摘要翻译: 用于时间,基于事件的视频指纹识别的计算机实现的方法,装置和计算机程序产品代码。 在一个实施例中,检测视频内容中的事件。 视频内容包括多个视频帧。 事件表示视频内容中的离散点。 使用事件生成一组基于事件的时间段。 每个时间的基于事件的片段是覆盖一组事件的视频内容的片段。 使用对与每个基于事件的片段相关联的一组帧的基于内容的特征的时间跟踪从每个基于时间的基于事件的片段导出时间序列信号。 基于每个基于时间的事件的片段的时间序列信号提取基于时间片段的指纹,以形成与视频内容相关联的一组基于时间片段的指纹。

    Method and Apparatus for Semantic Assisted Rating of Multimedia Content
    8.
    发明申请
    Method and Apparatus for Semantic Assisted Rating of Multimedia Content 有权
    多媒体内容语义辅助评估方法与装置

    公开(公告)号:US20090234831A1

    公开(公告)日:2009-09-17

    申请号:US12046206

    申请日:2008-03-11

    IPC分类号: G06F7/06 G06F17/30

    摘要: The present invention is directed to a method and apparatus for assisting in rating and filtering multimedia content, such as images, videos and sound recordings. One embodiment comprises a computer implemented method for rating the objectionability of specified digital content that comprises one or more discrete content items, wherein the method includes the step of moving the specified content to one or more filtering stages in a succession of filtering stages. After the specified content is moved to a given one of the filtering stages, a rating procedure is carried out to determine whether a rating can be applied to one or more of the content items, and if so, a selected rating is applied to each of the one or more content items. The method further comprises moving content items of the specified content to the next stage in the succession after the given stage, when at least one content item of the specified content remains without rating, after the rating procedure at the given stage. When none of the content items of the specified content remains without a rating after the rating procedure has been completed at the given stage, ratings that have been respectively applied to at least some of the content items are selectively processed, in order to determine an overall objectionability rating for the specified content.

    摘要翻译: 本发明涉及一种用于协助评估和过滤诸如图像,视频和录音的多媒体内容的方法和装置。 一个实施例包括用于评估包括一个或多个离散内容项目的指定数字内容的不良性的计算机实现的方法,其中该方法包括将指定内容移动到一系列过滤阶段中的一个或多个过滤阶段的步骤。 在将指定内容移动到给定的一个过滤阶段之后,执行评级过程以确定评级是否可应用于一个或多个内容项,如果是,则将所选评级应用于 一个或多个内容项。 该方法还包括在给定阶段之后的指定内容的至少一个内容项目在给定阶段的评级过程之后保持没有评级的情况下,将指定内容的内容项移动到下一阶段。 当在给定阶段在评级程序完成之后,指定内容的内容项目中没有任何内容项目没有得到评级时,已经分别应用于至少一些内容项目的评级被选择性地处理,以便确定总体 指定内容的异议评级。

    Methods of imaging based on wavelet retrieval of scenes
    9.
    发明授权
    Methods of imaging based on wavelet retrieval of scenes 有权
    基于场景小波检索的成像方法

    公开(公告)号:US06751363B1

    公开(公告)日:2004-06-15

    申请号:US09371112

    申请日:1999-08-10

    IPC分类号: G06K954

    摘要: Methods of imaging objects based on wavelet retrieval of scenes utilize wavelet transformation of plural defined regions of a query image. By increasing the granularity of the query image to greater than one region, accurate feature vectors are obtained that allow for robust extraction of corresponding regions from a database of target images. The methods further include the use of sliding windows to decompose the query and target images into regions, and the clustering of the regions utilizing a novel similarity metric that ensures robust image matching in low response times.

    摘要翻译: 基于场景小波检索的物体成像方法利用查询图像的多个限定区域的小波变换。 通过将查询图像的粒度提高到大于一个区域,获得准确的特征向量,其允许从目标图像的数据库中鲁棒地提取对应的区域。 这些方法还包括使用滑动窗口将查询和目标图像分解成区域,以及利用新颖的相似性度量来聚类区域,以确保在低响应时间内稳健的图像匹配。