Invention Grant
- Patent Title: System for continuous monitoring of data quality in a dynamic feed environment
-
Application No.: US14813403Application Date: 2015-07-30
-
Publication No.: US10191962B2Publication Date: 2019-01-29
- Inventor: Vladislav Shkapenyuk , Tamraparni Dasu , Divesh Srivastava , Deborah Swayne
- Applicant: AT&T INTELLECTUAL PROPERTY I, L.P.
- Applicant Address: US GA Atlanta
- Assignee: AT&T INTELLECTUAL PROPERTY I, L.P.
- Current Assignee: AT&T INTELLECTUAL PROPERTY I, L.P.
- Current Assignee Address: US GA Atlanta
- Agency: Akerman LLP
- Agent Michael K. Dixon; Mammen (Roy) P. Zachariah, Jr.
- Main IPC: G06F17/30
- IPC: G06F17/30

Abstract:
A system for providing continuous monitoring of data quality in a dynamic feed environment is disclosed. In particular, the system utilizes a feed inspection tool to detect anomalies in data gathering detected from feed metadata and anomalies in data measurement detected based on file contents. In order to do so, the feed inspection tool may aggregate, for a plurality of aggregation intervals, data feeds and associated metadata feeds. Once the data feeds and metadata feeds are aggregated, the feed inspection tool may generate, for a baseline model feed, baseline statistical models by utilizing historical data of the aggregated feeds in sliding windows of different lengths. The feed inspection tool may then identify, for a plurality of monitoring time delays, data outliers by comparing the aggregated feeds with the baseline model feed. A data quality feed based on the data outliers identified may then be generated and published.
Public/Granted literature
- US20170032015A1 System For Continuous Monitoring Of Data Quality In A Dynamic Feed Environment Public/Granted day:2017-02-02
Information query