A method, apparatus and computer program product for automatically reconfiguring a policy of a multi-tenant service is disclosed. A first tenant specific policy for a first tenant of a plurality of tenants serviced by the multi-tenant service is provided. The multi-tenant service uses a second tenant specific policy different from the first tenant specific policy for a second tenant of the plurality of tenants. An event relevant to the first tenant specific policy is detected. The first tenant specific policy is reconfigured according to the detected event.