Method and system for detecting anomalies in a data pipeline

    公开(公告)号:US11288260B2

    公开(公告)日:2022-03-29

    申请号:US17306265

    申请日:2021-05-03

    申请人: OVH

    IPC分类号: G06F16/23 G06F17/18

    摘要: A method and system for detecting anomalies in a data pipeline are disclosed. Data tables are extracted from data pipelines. A best time column is calculated for each data table. Table lines are aggregated so as to establish counts of data lines per a time interval, and corresponding sequences of points are produced that are being analysed through regression methods. An anomaly is raised when points have counts of data lines that lie outside confidence intervals around expected values for such counts.