A system and method for virtualizing a flow switch to be used by application providers in a cloud computing environment is provided. An application provider's packet handling rules are received by a cloud management system. The rules are translated from the application provider's overlay topology to the underlay data center topology. The underlay network elements involved in the received rules can be identified. A translated rule can be decomposed into a plurality of rule portions which are transmitted to the appropriate underlay network elements.