A multi-needle quilting machine is provided with a common drive that drives the needles and loopers. It may also drive the presser foot assembly. In the illustrated embodiment, a drive motor drives a rotating drive shaft. The drive shaft has an off-center drive assembly connected to it that rocks a needle rocker shaft as well as looper rocker shafts, and also a presser foot shaft. The off-center drive includes a pair of eccentrics on the drive shaft at each side of the machine. Each eccentric oscillates a linkage plate that is fixed to a shaft such as the needle rocker shaft and is also linked to the looper rocker shafts and the presser foot shaft. The eccentric thereby reciprocates the needles and oscillates the loopers, as well as reciprocates the presser foot plate, in permanent synchronization.