An information handling system having a plurality of modular servers and input-output (I/O) modules use virtual bridge switches to couple any of the plurality of modular servers to any of the I/O modules. This allows the modular servers to have the I/O connectivity dictated by the computing environment rather than having a fixed I/O assignment. The modular servers and I/O modules may be coupled together through serial I/O interfaces. Input and output buffers may be used to manage data flow traffic and multiplexers may be used to steer data to the appropriate input and output buffers. Control logic may be used to control the multiplexers and a programmable I/O mapping table may be used to describe which modular servers are coupled to which I/O modules.