A modular pump skid includes a base, a prime mover mounted on the base, and one or more hydraulic pump circuits removably mounted on the base and operationally coupled to the prime mover, wherein each hydraulic pump circuit has a hydraulic pump operationally coupled to the prime mover and a hydraulically driven pump fluidly coupled to the hydraulic pump. Each hydraulic pump circuit is in a closed loop independent of other hydraulic pump circuits.