Digital video content fingerprinting based on scale invariant interest region detection with an array of anisotropic filters
    1.
    发明授权
    Digital video content fingerprinting based on scale invariant interest region detection with an array of anisotropic filters 有权
    基于尺度不变兴趣区域检测的数字视频内容指纹与各向异性过滤器阵列

    公开(公告)号:US09396393B2

    公开(公告)日:2016-07-19

    申请号:US14298261

    申请日:2014-06-06

    摘要: Video sequence processing is described with various filtering rules applied to extract dominant features for content based video sequence identification. Active regions are determined in video frames of a video sequence. Video frames are selected in response to temporal statistical characteristics of the determined active regions. A two pass analysis is used to detect a set of initial interest points and interest regions in the selected video frames to reduce the effective area of images that are refined by complex filters that provide accurate region characterizations resistant to image distortion for identification of the video frames in the video sequence. Extracted features and descriptors are robust with respect to image scaling, aspect ratio change, rotation, camera viewpoint change, illumination and contrast change, video compression/decompression artifacts and noise. Compact, representative signatures are generated for video sequences to provide effective query video matching and retrieval in a large video database.

    摘要翻译: 使用应用于提取用于基于内容的视频序列识别的主要特征的各种滤波规则来描述视频序列处理。 在视频序列的视频帧中确定有效区域。 响应于所确定的活动区域的时间统计特性来选择视频帧。 双通道分析用于检测所选择的视频帧中的一组初始兴趣点和感兴趣区域,以减少由复杂滤波器精化的图像的有效面积,该复杂滤波器提供抵抗图像失真的精确区域表征以识别视频帧 在视频序列中。 提取的特征和描述符在图像缩放,宽高比变化,旋转,相机视点改变,照明和对比度变化,视频压缩/解压缩伪像和噪声方面是稳健的。 为视频序列生成紧凑的代表性签名,以便在大型视频数据库中提供有效的查询视频匹配和检索。

    Digital Video Content Fingerprinting Based on Scale Invariant Interest Region Detection with an Array of Anisotropic Filters
    2.
    发明申请
    Digital Video Content Fingerprinting Based on Scale Invariant Interest Region Detection with an Array of Anisotropic Filters 有权
    基于尺度不变兴趣区域的数字视频内容指纹识别与各向异性滤波器阵列

    公开(公告)号:US20120207402A1

    公开(公告)日:2012-08-16

    申请号:US13455560

    申请日:2012-04-25

    IPC分类号: G06K9/40

    摘要: Video sequence processing is described with various filtering rules applied to extract dominant features for content based video sequence identification. Active regions are determined in video frames of a video sequence. Video frames are selected in response to temporal statistical characteristics of the determined active regions. A two pass analysis is used to detect a set of initial interest points and interest regions in the selected video frames to reduce the effective area of images that are refined by complex filters that provide accurate region characterizations resistant to image distortion for identification of the video frames in the video sequence. Extracted features and descriptors are robust with respect to image scaling, aspect ratio change, rotation, camera viewpoint change, illumination and contrast change, video compression/decompression artifacts and noise. Compact, representative signatures are generated for video sequences to provide effective query video matching and retrieval in a large video database.

    摘要翻译: 使用应用于提取用于基于内容的视频序列识别的主要特征的各种滤波规则来描述视频序列处理。 在视频序列的视频帧中确定有效区域。 响应于所确定的活动区域的时间统计特性来选择视频帧。 双通道分析用于检测所选择的视频帧中的一组初始兴趣点和感兴趣区域,以减少由复杂滤波器精化的图像的有效面积,该复杂滤波器提供抵抗图像失真的精确区域表征以识别视频帧 在视频序列中。 提取的特征和描述符在图像缩放,宽高比变化,旋转,相机视点改变,照明和对比度变化,视频压缩/解压缩伪像和噪声方面是稳健的。 为视频序列生成紧凑的代表性签名,以便在大型视频数据库中提供有效的查询视频匹配和检索。

    Media fingerprinting and identification system
    3.
    发明授权
    Media fingerprinting and identification system 有权
    媒体指纹识别系统

    公开(公告)号:US09195663B2

    公开(公告)日:2015-11-24

    申请号:US14711054

    申请日:2015-05-13

    IPC分类号: G06F17/30

    摘要: The overall architecture and details of a scalable video fingerprinting and identification system that is robust with respect to many classes of video distortions is described. In this system, a fingerprint for a piece of multimedia content is composed of a number of compact signatures, along with traversal hash signatures and associated metadata. Numerical descriptors are generated for features found in a multimedia clip, signatures are generated from these descriptors, and a reference signature database is constructed from these signatures. Query signatures are also generated for a query multimedia clip. These query signatures are searched against the reference database using a fast similarity search procedure, to produce a candidate list of matching signatures. This candidate list is further analyzed to find the most likely reference matches. Signature correlation is performed between the likely reference matches and the query clip to improve detection accuracy.

    摘要翻译: 描述了关于许多类视频失真的鲁棒性的可扩展视频指纹识别系统的总体架构和细节。 在该系统中,用于一张多媒体内容的指纹由许多紧凑签名以及遍历哈希签名和相关联的元数据组成。 为多媒体剪辑中发现的特征生成数字描述符,从这些描述符生成签名,并从这些签名构建参考签名数据库。 还为查询多媒体剪辑生成查询签名。 使用快速相似性搜索过程针对参考数据库搜索这些查询签名,以产生匹配签名的候选列表。 进一步分析该候选列表以找到最可能的参考匹配。 在可能的参考匹配和查询剪辑之间执行签名相关性,以提高检测精度。

    Scalable, Adaptable, and Manageable System for Multimedia Identification
    4.
    发明申请
    Scalable, Adaptable, and Manageable System for Multimedia Identification 有权
    可扩展,适应性和可管理的多媒体识别系统

    公开(公告)号:US20150254344A1

    公开(公告)日:2015-09-10

    申请号:US14718218

    申请日:2015-05-21

    IPC分类号: G06F17/30

    摘要: An architecture for a multimedia search system is described. To perform similarity matching of multimedia query frames against reference content, reference database comprising of a cluster index using cluster keys to perform similarity matching and a multimedia index to perform sequence matching is built. Methods to update and maintain the reference database that enables addition and removal of the multimedia contents, including portions of multimedia content, from the reference database in a running system are described. Hierarchical multi-level partitioning methods to organize the reference database are presented. Smart partitioning of the reference multimedia content according to the nature of the multimedia content, and according to the popularity among the social media, that supports scalable fast multimedia identification is also presented. A caching mechanism for multimedia search queries in a centralized or in a decentralized distributed system and a client based local multimedia search system enabling multimedia tracking are described.

    摘要翻译: 描述了用于多媒体搜索系统的架构。 为了执行多媒体查询帧与参考内容的相似性匹配,构建了使用集群密钥进行相似性匹配的集群索引的参考数据库和执行序列匹配的多媒体索引。 描述了在运行系统中更新和维护参考数据库的方法,该参考数据库能够从参考数据库添加和删除包括多媒体内容的多媒体内容的多媒体内容。 提出了组织参考数据库的分层多级分区方法。 根据多媒体内容的性质,根据社交媒体的流行度,对参考多媒体内容进行智能划分,支持可扩展快速多媒体识别。 描述了一种用于集中式或分散式分布式系统中的多媒体搜索查询的缓存机制以及启用多媒体跟踪的基于客户端的本地多媒体搜索系统。

    Media Fingerprinting and Identification System
    5.
    发明申请
    Media Fingerprinting and Identification System 有权
    媒体指纹识别系统

    公开(公告)号:US20150242399A1

    公开(公告)日:2015-08-27

    申请号:US14711054

    申请日:2015-05-13

    IPC分类号: G06F17/30

    摘要: The overall architecture and details of a scalable video fingerprinting and identification system that is robust with respect to many classes of video distortions is described. In this system, a fingerprint for a piece of multimedia content is composed of a number of compact signatures, along with traversal hash signatures and associated metadata. Numerical descriptors are generated for features found in a multimedia clip, signatures are generated from these descriptors, and a reference signature database is constructed from these signatures. Query signatures are also generated for a query multimedia clip. These query signatures are searched against the reference database using a fast similarity search procedure, to produce a candidate list of matching signatures. This candidate list is further analyzed to find the most likely reference matches. Signature correlation is performed between the likely reference matches and the query clip to improve detection accuracy.

    摘要翻译: 描述了关于许多类视频失真的鲁棒性的可扩展视频指纹识别系统的总体架构和细节。 在该系统中,用于一张多媒体内容的指纹由许多紧凑签名以及遍历哈希签名和相关联的元数据组成。 为多媒体剪辑中发现的特征生成数字描述符,从这些描述符生成签名,并从这些签名构建参考签名数据库。 还为查询多媒体剪辑生成查询签名。 使用快速相似性搜索过程针对参考数据库搜索这些查询签名,以产生匹配签名的候选列表。 进一步分析该候选列表以找到最可能的参考匹配。 在可能的参考匹配和查询剪辑之间执行签名相关性,以提高检测精度。

    Media Fingerprinting and Identification System
    6.
    发明申请
    Media Fingerprinting and Identification System 有权
    媒体指纹识别系统

    公开(公告)号:US20140052737A1

    公开(公告)日:2014-02-20

    申请号:US14059688

    申请日:2013-10-22

    IPC分类号: G06F17/30

    摘要: The overall architecture and details of a scalable video fingerprinting and identification system that is robust with respect to many classes of video distortions is described. In this system, a fingerprint for a piece of multimedia content is composed of a number of compact signatures, along with traversal hash signatures and associated metadata. Numerical descriptors are generated for features found in a multimedia clip, signatures are generated from these descriptors, and a reference signature database is constructed from these signatures. Query signatures are also generated for a query multimedia clip. These query signatures are searched against the reference database using a fast similarity search procedure, to produce a candidate list of matching signatures. This candidate list is further analyzed to find the most likely reference matches. Signature correlation is performed between the likely reference matches and the query clip to improve detection accuracy.

    摘要翻译: 描述了关于许多类视频失真的鲁棒性的可扩展视频指纹识别系统的总体架构和细节。 在该系统中,用于一张多媒体内容的指纹由许多紧凑签名以及遍历哈希签名和相关联的元数据组成。 为多媒体剪辑中发现的特征生成数字描述符,从这些描述符生成签名,并从这些签名构建参考签名数据库。 还为查询多媒体剪辑生成查询签名。 使用快速相似性搜索过程针对参考数据库搜索这些查询签名,以产生匹配签名的候选列表。 进一步分析该候选列表以找到最可能的参考匹配。 在可能的参考匹配和查询剪辑之间执行签名相关性,以提高检测精度。

    Media Fingerprinting and Identification System
    7.
    发明申请
    Media Fingerprinting and Identification System 有权
    媒体指纹识别系统

    公开(公告)号:US20120215789A1

    公开(公告)日:2012-08-23

    申请号:US13463137

    申请日:2012-05-03

    IPC分类号: G06F17/30

    摘要: The overall architecture and details of a scalable video fingerprinting and identification system that is robust with respect to many classes of video distortions is described. In this system, a fingerprint for a piece of multimedia content is composed of a number of compact signatures, along with traversal hash signatures and associated metadata. Numerical descriptors are generated for features found in a multimedia clip, signatures are generated from these descriptors, and a reference signature database is constructed from these signatures. Query signatures are also generated for a query multimedia clip. These query signatures are searched against the reference database using a fast similarity search procedure, to produce a candidate list of matching signatures. This candidate list is further analyzed to find the most likely reference matches. Signature correlation is performed between the likely reference matches and the query clip to improve detection accuracy.

    摘要翻译: 描述了关于许多类视频失真的鲁棒性的可扩展视频指纹识别系统的总体架构和细节。 在该系统中,用于一张多媒体内容的指纹由许多紧凑签名以及遍历哈希签名和相关联的元数据组成。 为多媒体剪辑中发现的特征生成数字描述符,从这些描述符生成签名,并从这些签名构建参考签名数据库。 还为查询多媒体剪辑生成查询签名。 使用快速相似性搜索过程针对参考数据库搜索这些查询签名,以产生匹配签名的候选列表。 进一步分析该候选列表以找到最可能的参考匹配。 在可能的参考匹配和查询剪辑之间执行签名相关性,以提高检测精度。

    Digital Video Content Fingerprinting Based on Scale Invariant Interest Region Detection with an Array of Anisotropic Filters
    8.
    发明申请
    Digital Video Content Fingerprinting Based on Scale Invariant Interest Region Detection with an Array of Anisotropic Filters 有权
    基于尺度不变兴趣区域的数字视频内容指纹识别与各向异性滤波器阵列

    公开(公告)号:US20100303338A1

    公开(公告)日:2010-12-02

    申请号:US12612729

    申请日:2009-11-05

    IPC分类号: G06K9/00 G06K9/46 G06K9/40

    摘要: Video sequence processing is described with various filtering rules applied to extract dominant features for content based video sequence identification. Active regions are determined in video frames of a video sequence. Video frames are selected in response to temporal statistical characteristics of the determined active regions. A two pass analysis is used to detect a set of initial interest points and interest regions in the selected video frames to reduce the effective area of images that are refined by complex filters that provide accurate region characterizations resistant to image distortion for identification of the video frames in the video sequence. Extracted features and descriptors are robust with respect to image scaling, aspect ratio change, rotation, camera viewpoint change, illumination and contrast change, video compression/decompression artifacts and noise. Compact, representative signatures are generated for video sequences to provide effective query video matching and retrieval in a large video database.

    摘要翻译: 使用应用于提取用于基于内容的视频序列识别的主要特征的各种滤波规则来描述视频序列处理。 在视频序列的视频帧中确定有效区域。 响应于所确定的活动区域的时间统计特性来选择视频帧。 双通道分析用于检测所选择的视频帧中的一组初始兴趣点和感兴趣区域,以减少由复杂滤波器精化的图像的有效面积,该复杂滤波器提供抵抗图像失真的精确区域表征以识别视频帧 在视频序列中。 提取的特征和描述符在图像缩放,宽高比变化,旋转,相机视点改变,照明和对比度变化,视频压缩/解压缩伪像和噪声方面是稳健的。 为视频序列生成紧凑的代表性签名,以便在大型视频数据库中提供有效的查询视频匹配和检索。

    Scalable, adaptable, and manageable system for multimedia identification
    9.
    发明授权
    Scalable, adaptable, and manageable system for multimedia identification 有权
    可扩展,适应性强和可管理的多媒体识别系统

    公开(公告)号:US09058355B1

    公开(公告)日:2015-06-16

    申请号:US14151335

    申请日:2014-01-09

    IPC分类号: G06F17/30

    摘要: An architecture for a multimedia search system is described. To perform similarity matching of multimedia query frames against reference content, reference database comprising of a cluster index using cluster keys to perform similarity matching and a multimedia index to perform sequence matching is built. Methods to update and maintain the reference database that enables addition and removal of the multimedia contents, including portions of multimedia content, from the reference database in a running system are described. Hierarchical multi-level partitioning methods to organize the reference database are presented. Smart partitioning of the reference multimedia content according to the nature of the multimedia content, and according to the popularity among the social media, that supports scalable fast multimedia identification is also presented. A caching mechanism for multimedia search queries in a centralized or in a decentralized distributed system and a client based local multimedia search system enabling multimedia tracking are described.

    摘要翻译: 描述了用于多媒体搜索系统的架构。 为了执行多媒体查询帧与参考内容的相似性匹配,构建了使用集群密钥进行相似性匹配的集群索引的参考数据库和执行序列匹配的多媒体索引。 描述了在运行系统中更新和维护参考数据库的方法,该参考数据库能够从参考数据库添加和删除包括多媒体内容的多媒体内容的多媒体内容。 提出了组织参考数据库的分层多级分区方法。 根据多媒体内容的性质,根据社交媒体的流行度,对参考多媒体内容进行智能划分,支持可扩展快速多媒体识别。 描述了一种用于集中式或分散式分布式系统中的多媒体搜索查询的缓存机制以及启用多媒体跟踪的基于客户端的本地多媒体搜索系统。

    Distributed and Tiered Architecture for Content Search and Content Monitoring
    10.
    发明申请
    Distributed and Tiered Architecture for Content Search and Content Monitoring 有权
    分布式和分层架构,用于内容搜索和内容监控

    公开(公告)号:US20150112988A1

    公开(公告)日:2015-04-23

    申请号:US14589366

    申请日:2015-01-05

    IPC分类号: G06F17/30

    摘要: An efficient large scale search system for video and multi-media content using a distributed database and search, and tiered search servers is described. Selected content is stored at the distributed local database and tier1 search server(s). Content matching frequent queries, and frequent unidentified queries are cached at various levels in the search system. Content is classified using feature descriptors and geographical aspects, at feature level and in time segments. Queries not identified at clients and tier1 search server(s) are queried against tier2 or lower search server(s). Search servers use classification and geographical partitioning to reduce search cost. Methods for content tracking and local content searching are executed on clients. The client performs local search, monitoring and/or tracking of the query content with the reference content and local search with a database of reference fingerprints. This shifts the content search workload from central servers to the distributed monitoring clients.

    摘要翻译: 描述了使用分布式数据库和搜索以及分层搜索服务器的视频和多媒体内容的高效大规模搜索系统。 所选内容存储在分布式本地数据库和tier1搜索服务器上。 内容匹配频繁查询和频繁的不明查询在搜索系统的各个级别进行缓存。 内容使用特征描述符和地理方面,在特征级别和时间段中进行分类。 在客户端和tier1搜索服务器上未识别的查询被查询到tier2或更低的搜索服务器。 搜索服务器使用分类和地理分区来降低搜索成本。 在客户端执行内容跟踪和本地内容搜索的方法。 客户端用参考内容和具有参考指纹数据库的本地搜索来执行查询内容的本地搜索,监视和/或跟踪。 这将内容搜索工作负载从中央服务器转移到分布式监控客户端。