A cooling system for a rack of servers includes a plurality of cooling circuits, where each cooling circuit is coupled to a server of the rack. Each cooling circuit includes a plurality of cooling modules arranged in parallel. Each cooling module includes a cold plate having a cooling conduit passing therethrough, and a pump fluidly coupled to the cooling conduit. The cooling circuit further includes one or more valves fluidly interconnecting the plurality of cooling modules. Each of the one or more valves, when turned on, fluidly connects the cooling conduits of any two adjacent cooling modules. The cooling system further includes a first cooling distribution manifold fluidly connected to the cooling circuit of each of the plurality of servers through an inlet pipe, and a second cooling distribution manifold fluidly connected to the cooling circuit of each of the plurality of servers through an outlet pipe.