A testing and performance analysis methodology applies a series of test vector pairs to the input ports of an echo canceller under test. The test vector signal pair may represent a particular speech activity state transition, e.g., a Brady Model transition. A scoring compression function such as a sigmoid squashing function is used to evaluate quantized performance parameters. The sub-scores may be weighted and averaged to provide an overall performance score.