End-to-end testing of a communications network, specifically a unified communications network, is accomplished by employing one or more sets of agents controlled by one or more organizers. Agents, capable of initiating, emulating, and recording various aspects of communication, are deployed such that call can be made through a wide range of network paths. Test scenarios defined dynamically based on network conditions or based on administrator input are executed by an organizer, which directs the agents reporting to it. Collected results are analyzed for subsequent reporting and/or corrective actions. Alert criteria may also be defined causing an alert to be issued if a significant fault is discovered.