Streaming and sampling in real-time log analysis
    2.
    发明授权
    Streaming and sampling in real-time log analysis 有权
    流和采样实时日志分析

    公开(公告)号:US08850263B1

    公开(公告)日:2014-09-30

    申请号:US13619344

    申请日:2012-09-14

    IPC分类号: G06F11/00

    摘要: Technologies are described herein for incorporating streaming and/or sampling in real-time log analysis. Representative samples of log data are extracted from the log files on a number of monitored hosts and streamed in real-time to log processors for processing. The log processors accumulate and process the representative samples of log data, and track a data completeness value representing an indication of a proportion of total log data represented by the representative samples received. The representative samples of log data are merged and collated. Estimated metrics are calculated from the merged and collated representative samples and the data completeness, and the estimated metrics are published to consumers in near real-time.

    摘要翻译: 本文描述了在实时日志分析中结合流和/或采样的技术。 日志数据的代表性样本从多个受监视主机上的日志文件中提取,并实时流式传输到日志处理器进行处理。 日志处理器累积并处理日志数据的代表性样本,并且跟踪表示由所接收的代表性样本表示的总日志数据的比例的指示的数据完整性值。 日志数据的代表性样本被合并和整理。 估计的指标是从合并和整理的代表性样本和数据的完整性中计算出来的,估计的指标将近似实时地发布给消费者。