System and method for analyzing streams and counting stream items on multi-core processors
    5.
    发明授权
    System and method for analyzing streams and counting stream items on multi-core processors 失效
    用于分析多核处理器上的流和计数流项目的系统和方法

    公开(公告)号:US08321579B2

    公开(公告)日:2012-11-27

    申请号:US11828732

    申请日:2007-07-26

    IPC分类号: G06F15/16

    CPC分类号: G06F17/18

    摘要: Systems and methods for parallel stream item counting are disclosed. A data stream is partitioned into portions and the portions are assigned to a plurality of processing cores. A sequential kernel is executed at each processing core to compute a local count for items in an assigned portion of the data stream for that processing core. The counts are aggregated for all the processing cores to determine a final count for the items in the data stream. A frequency-aware counting method (FCM) for data streams includes dynamically capturing relative frequency phases of items from a data stream and placing the items in a sketch structure using a plurality of hash functions where a number of hash functions is based on the frequency phase of the item. A zero-frequency table is provided to reduce errors due to absent items.

    摘要翻译: 公开了并行流项计数的系统和方法。 将数据流划分为多个部分,并将这些部分分配给多个处理核。 在每个处理核心处执行顺序内核以计算用于该处理核心的数据流的分配部分中的项目的本地计数。 为所有处理核心聚合计数,以确定数据流中项目的最终计数。 用于数据流的频率感知计数方法(FCM)包括从数据流动态地捕获项目的相对频率相位,并且使用多个散列函数将项目放置在草图结构中,其中多个散列函数基于频率相位 的项目。 提供零频率表以减少由于缺少项目导致的错误。