公开(公告)号：US08805560B1

公开(公告)日：2014-08-12

申请号：US13276318

申请日：2011-10-18

Applicant: George Tzanetakis ,  Dominik Roblek ,  Matthew Sharifi

Inventor： George Tzanetakis ,  Dominik Roblek ,  Matthew Sharifi

IPC: G10L11/00 ,  G10L21/02

CPC classification number: G06F17/30743 ,  G06F17/30758 ,  G10L25/54

Abstract: Systems and methods for noise based interest point density pruning are disclosed herein. The systems include determining an amount of noise in an audio sample and adjusting the amount of interest points within an audio sample fingerprint based on the amount of noise. Samples containing high amounts of noise correspondingly generate fingerprints with more interest points. The disclosed systems and methods allow reference fingerprints to be reduced in size while increasing the size of sample fingerprints. The benefits in scalability do not compromise the accuracy of an audio matching system using noise based interest point density pruning.

Abstract translation: 本文公开了基于噪声的兴趣点密度修剪的系统和方法。 系统包括确定音频样本中的噪声量，并且基于噪声量来调整音频样本指纹内的兴趣点的数量。 含有大量噪声的样本相应地产生了具有更多兴趣点的指纹。 所公开的系统和方法允许参考指纹的尺寸减小，同时增加样本指纹的大小。 可扩展性的优点不会影响使用基于噪声的兴趣点密度修剪的音频匹配系统的准确性。

公开(公告)号：US09148738B1

公开(公告)日：2015-09-29

申请号：US13435700

申请日：2012-03-30

Applicant: Matthew Sharifi ,  Dominik Roblek

Inventor： Matthew Sharifi ,  Dominik Roblek

IPC: H04R29/00 ,  G06F17/00 ,  G10L21/00 ,  G06F17/27 ,  H04M1/64

CPC classification number: H04R29/00 ,  G06F17/00 ,  G06F17/27 ,  G10L21/00 ,  G10L25/54 ,  G10L25/87 ,  H04M1/64

Abstract: System and methods for characterizing interest points within a descriptor are disclosed herein. The systems include generating a set of interest points related to an audio sample. A set of gradients relating to respective interest points in the set of interest points can be generated. A set of descriptors can then be generated based upon the set of interest points and the set of gradients and used in comparison to reference descriptors to identify the audio sample. The disclosed systems and methods provide for an audio matching system robust to pitch-shift distortion by using gradients that characterize the time-frequency neighborhood around an interest point rather than solely relying on interest points themselves. Thus, the disclosed system and methods result in more accurate audio identification.

Abstract translation: 本文公开了描述符内的兴趣点的表征的系统和方法。 该系统包括生成与音频样本相关的一组兴趣点。 可以产生与该组利益点中的各利益点有关的一组梯度。 然后可以基于感兴趣点集合和梯度集合来生成一组描述符，并且与参考描述符进行比较以用于识别音频样本。 所公开的系统和方法通过使用表征兴趣点周围的时频邻域的梯度而不是仅依赖于兴趣点本身来提供对音调移位失真鲁棒的音频匹配系统。 因此，所公开的系统和方法导致更准确的音频识别。

公开(公告)号：US09113202B1

公开(公告)日：2015-08-18

申请号：US13239138

申请日：2011-09-21

Applicant: Matthew Wiseman ,  Matthew Sharifi ,  Yaniv Bernstein ,  Annie Chen ,  Dominik Roblek

Inventor： Matthew Wiseman ,  Matthew Sharifi ,  Yaniv Bernstein ,  Annie Chen ,  Dominik Roblek

IPC: H04N21/439 ,  H04L7/08 ,  H04N21/84

CPC classification number: H04N21/4394 ,  G06F17/30743 ,  G06K9/00744 ,  G06K9/00758 ,  H04L7/08 ,  H04N21/8358 ,  H04N21/84

Abstract: A technique for inverted client side fingerprinting and matching provides the benefits of disposable fingerprinting to identify multiple content streams from multiple clients without overloading a fingerprinting system. Rather than tasking a fingerprinting system with the generation and comparison of all fingerprints, the technique distributes some fingerprinting tasks to the clients receiving the content streams. As a result, the fingerprinting system is not bottlenecked by fingerprinting tasks. In one embodiment, the fingerprinting system can provide additional services to the clients.

Abstract translation: 用于反向客户端指纹和匹配的技术提供了一次性指纹识别的优点，以便从多个客户端识别多个内容流而不会使指纹系统过载。 该指纹技术将指纹识别任务分配给接收内容流的客户端，而不是通过生成和比较所有指纹来对指纹系统进行任务。 因此，指纹识别系统不会由于指纹识别任务的瓶颈。 在一个实施例中，指纹系统可以向客户端提供附加服务。

公开(公告)号：US20140185815A1

公开(公告)日：2014-07-03

申请号：US13732108

申请日：2012-12-31

Applicant: Dominik Roblek ,  Matthew Sharifi

Inventor： Dominik Roblek ,  Matthew Sharifi

IPC: H04R29/00

CPC classification number: G06F17/30743 ,  G06F17/30758 ,  G06F17/30769 ,  G10L25/54

Abstract: A matching system receives probe audio samples for comparison to references of a data store. Comparisons are generated to determine a sufficient match for a portion or a first amount of the probe sample. Ranking scores are assigned to the resulting match references. The match references are retained, unless meeting a score threshold. Comparisons are continually generated with second amounts of the probe sample and the retained references are updated with further matching references assigned ranking scores. The retained results are merged and determined to satisfy a score threshold for release as outputted results for matching references.

Abstract translation: 匹配系统接收探针音频样本，以便与数据存储的引用进行比较。 生成比较以确定探针样品的一部分或第一量的足够的匹配。 排名得分被分配给结果匹配引用。 匹配引用被保留，除非满足分数阈值。 使用第二量的探针样品不断生成比较，并且使用进一步的匹配参考指定排名分数来更新保留的参考。 保留的结果被合并并确定为满足用于匹配引用的输出结果的释放分数阈值。

公开(公告)号：US09390719B1

公开(公告)日：2016-07-12

申请号：US13648108

申请日：2012-10-09

Applicant: Dominik Roblek ,  Matthew Sharifi

Inventor： Dominik Roblek ,  Matthew Sharifi

IPC: G06F17/00 ,  G10L19/022 ,  G06F17/30 ,  G10L19/025 ,  G10L19/26

CPC classification number: G10L19/022 ,  G06F17/30743 ,  G10L19/025 ,  G10L19/26 ,  G10L25/51 ,  G10L25/60

Abstract: Systems and methods are provided herein relating to audio matching. The density and quality of interest points can be controlled to assure a small but uniform number of high quality interest points. By scoring interest points based on quality and comparing them over time, those interest points that maintain a high quality when compared with a varying number of neighboring interest points can be retained, while those interest points that do not maintain a high quality can be discarded. Thus, the scalability of an audio matching system can be improved while retaining accuracy.

Abstract translation: 本文提供了与音频匹配有关的系统和方法。 可以控制兴趣点的密度和质量，以确保高质量的兴趣点数量小而均匀。 通过根据质量对利益点进行评分并对其进行比较，可以保留与不同数量的邻近兴趣点相比保持高质量的兴趣点，而不能保持高质量的兴趣点可以被​​丢弃。 因此，可以在保持精度的同时提高音频匹配系统的可扩展性。

公开(公告)号：US09202472B1

公开(公告)日：2015-12-01

申请号：US13434832

申请日：2012-03-29

Applicant: Matthew Sharifi ,  Dominik Roblek ,  George Tzanetakis

Inventor： Matthew Sharifi ,  Dominik Roblek ,  George Tzanetakis

IPC: G06F17/30 ,  G10L19/018

CPC classification number: G10L19/018 ,  G10L25/03

Abstract: Systems and methods for generating unique pitch-resistant descriptors for audio clips are provided. In one or more embodiments, a descriptor for an audio clip is generated as a function of relative magnitudes between interest points within the audio clip's time-frequency representation. A number of techniques for leveraging the relative magnitudes to generate descriptors are considered. These techniques include ordering of interest points as a function of ascending or descending magnitude, creation of binary vectors based on magnitude comparisons between pairs of points, and calculation of quantized magnitude ratios between pairs of points. Descriptors generated based on relative magnitudes according to the techniques disclosed herein are relatively invariant to common transformations to the original audio clip, such as pitch shifting, time stretching, global volume changes, equalization, and/or dynamic range compression.

Abstract translation: 提供了用于为音频剪辑生成独特的音高描述符的系统和方法。 在一个或多个实施例中，音频剪辑的描述符作为音频剪辑的时间 - 频率表示内的兴趣点之间的相对幅度的函数被生成。 考虑了利用相对幅度来生成描述符的许多技术。 这些技术包括将兴趣点排序为上升或下降幅度的函数，基于点对之间的幅度比较的二进制向量的创建以及点对之间的量化幅度比的计算。 基于根据本文公开的技术的相对幅度生成的描述符对于原始音频剪辑的常见变换（例如音调偏移，时间延伸，全局音量变化，均衡和/或动态范围压缩）是相对不变的。

公开(公告)号：US08886543B1

公开(公告)日：2014-11-11

申请号：US13296899

申请日：2011-11-15

Applicant: Matthew Sharifi ,  George Tzanetakis ,  Annie Chen ,  Dominik Roblek

Inventor： Matthew Sharifi ,  George Tzanetakis ,  Annie Chen ,  Dominik Roblek

IPC: G10L11/00

CPC classification number: G10L19/018

Abstract: System and methods for characterizing interest points within a fingerprint are disclosed herein. The systems include generating a set of interest points and an anchor point related to an audio sample. A quantized absolute frequency of an anchor point can be calculated and used to calculate a set of quantized ratios. A fingerprint can then be generated based upon the set of quantized ratios and used in comparison to reference fingerprints to identify the audio sample. The disclosed systems and methods provide for an audio matching system robust to pitch-shift distortion by using quantized ratios within fingerprints rather than solely using absolute frequencies of interest points. Thus, the disclosed system and methods result in more accurate audio identification.

Abstract translation: 本文公开了用于表征指纹内的兴趣点的系统和方法。 系统包括产生一组感兴趣点和与音频样本相关的定位点。 锚定点的量化绝对频率可以被计算并用于计算一组量化比率。 然后可以基于所述量化比率的集合生成指纹，并且与参考指纹进行比较以用于识别音频样本。 所公开的系统和方法通过使用指纹内的量化比率而不是仅使用感兴趣点的绝对频率来提供对音调偏移失真鲁棒的音频匹配系统。 因此，所公开的系统和方法导致更准确的音频识别。

公开(公告)号：US08805683B1

公开(公告)日：2014-08-12

申请号：US13404978

申请日：2012-02-24

Applicant: Matthew Wiseman ,  Yaniv Bernstein ,  Daniel Switkin ,  Gheorghe M. Postelnicu ,  Matthew Sharifi ,  Annie Chen ,  Dominik Roblek

Inventor： Matthew Wiseman ,  Yaniv Bernstein ,  Daniel Switkin ,  Gheorghe M. Postelnicu ,  Matthew Sharifi ,  Annie Chen ,  Dominik Roblek

IPC: G10L15/00

CPC classification number: G10L15/22 ,  G06F17/30758 ,  G10L15/30 ,  G10L25/54

Abstract: An audio recognition service recognizes an audio sample across multiple content types. At least a partial set of results generated by the service are returned to a client while the audio sample is still being recorded and/or transmitted. The client additionally displays the results in real-time or near real-time to the user. The audio sample can be sent over a first HTTP connection and the results can be returned over a second HTTP connection. The audio recognition service further processes check-in selections received from the client for content items indicated by the results. Responsive to receiving the check-in selections, the service determines whether a user is eligible for a reward. If the user is eligible, the service provides the reward.

Abstract translation: 音频识别服务识别多种内容类型的音频样本。 当音频样本仍然被记录和/或发送时，由服务产生的至少一部分结果返回给客户机。 客户端另外向用户实时或接近实时显示结果。 音频样本可以通过第一个HTTP连接发送，并且可以通过第二个HTTP连接返回结果。 音频识别服务进一步处理从客户端接收的用于由结果指示的内容项的登记选择。 响应于接收签入选择，该服务确定用户是否有资格获得奖励。 如果用户符合条件，则该服务将提供奖励。

公开(公告)号：US20130235027A1

公开(公告)日：2013-09-12

申请号：US13417598

申请日：2012-03-12

Applicant: Matthew Sharifi ,  Annie Chen ,  Dominik Roblek

Inventor： Matthew Sharifi ,  Annie Chen ,  Dominik Roblek

IPC: G06F17/00

CPC classification number: G06F17/30241 ,  G06F17/3053 ,  G06F17/30817 ,  G06F17/30867 ,  G06F17/3087 ,  G06Q10/0637 ,  G09B29/006 ,  G09B29/007

Abstract: This disclosure relates to dynamic display of content consumption by geographic location. A recognition component recognizes content being consumed by a set of users, and identifies geographic locations of the consumption and a set of characteristics associated with the consumption. An aggregation component ranks the consumed content based on a subset of the characteristics associated with the consumption, and a display component generates a map displaying subsets of the consumed content as a function of respective rankings and geographic location.

Abstract translation: 本公开涉及通过地理位置动态显示内容消费。 识别组件识别由一组用户消费的内容，并且识别消费的地理位置和与消费相关联的一组特征。 聚合组件基于与消费相关联的特征的子集来排列消耗的内容，并且显示组件生成显示作为相应排名和地理位置的函数的消费内容的子集的映射。

公开(公告)号：US09268845B1

公开(公告)日：2016-02-23

申请号：US13415786

申请日：2012-03-08

Applicant: Matthew Sharifi ,  Gheorghe Postelnicu ,  Annie Chen ,  Dominik Roblek

Inventor： Matthew Sharifi ,  Gheorghe Postelnicu ,  Annie Chen ,  Dominik Roblek

IPC: G06F17/30

CPC classification number: G06F17/3074 ,  G06F17/30743

Abstract: Systems and methods audio matching using interest point overlap are disclosed herein. The systems include determining at least one matching reference segment based on a probe segment. Interest points for both the at least one matching reference segment and the probe segment can be generated. Probe segment interest points and matching reference segment interest points can be time aligned and frequency aligned. A count can be generated based on a number of overlapping interest points between each set of reference interest points and the set of probe segment interest points. The disclosed systems and methods allow false positive reference to be identified and eliminated based on the count. The benefits in eliminating false positive matches improve the accuracy of an audio matching system.

Abstract translation: 本文公开了使用兴趣点重叠的系统和方法音频匹配。 所述系统包括基于探测段来确定至少一个匹配的参考段。 可以生成至少一个匹配参考段和探针段的兴趣点。 探测段利息点和匹配参考段的兴趣点可以进行时间对齐和频率对齐。 可以基于每组参考兴趣点和探头段兴趣点集合之间的重叠的兴趣点的数量来生成计数。 所公开的系统和方法允许基于计数来识别和消除假阳性参考。 消除假阳性匹配的好处可以提高音频匹配系统的准确性。