A data integrity monitor that implements a rules-based engine that applies rules to aggregated metrics generated by an analysis system to validate the integrity of the metrics. The rules may specify tolerances for particular metrics to help prevent false positives. An appropriate action or actions may be taken when a discrepancy is discovered. The data integrity monitor may perform the data integrity checks on copies of data accessed from a data store by consumers, which may reduce the number of accesses to the data store. The data integrity checks may be performed on copies of the accessed data “offline” by the data integrity monitor so that latency is not introduced into the consumers' accesses of the information.