A continuous speech recognition system includes a plurality of processors doing template comparisons of speech data. Each processor has an associated memory shared with the other processors by direct memory access (DMA) through a shared data bus. The DMA circuitry is distributed between the processors to eliminate redundancy, since if each processor had a full DMA circuit, one of the circuits would be idle when the processors communicated.