A fully distributed system for testing a distributed computing system utilizes test services exposed in conjunction by independent test components deployed on one or more computing nodes of the distributed computing system. The test services ensure dynamic and adaptive coordination amongst the test components. The test services include but are not limited to: an atomic synchronization service; a distributed shared memory service; a lock manager service; a publish/subscribe service; and a producer/consumer service.