In one embodiment, a device forms a telemetry cluster by applying clustering to telemetry data regarding a plurality of network connections over an access network between a plurality of entities and a remote application. The device applies anomaly detection to the telemetry cluster, to identify one or more anomalies. The device makes a determination as to whether the one or more anomalies are attributable to the remote application or to the access network. The device initiates a corrective measure, based on the determination as to whether the one or more anomalies are attributable to the remote application or to the access network.