Provided are techniques for providing dynamic throttling thresholds. A request from a client is received. A request count is incremented. A current dynamic throttling threshold is selected based on the request. In response to determining that the request count is less than the current dynamic throttling threshold, the request is sent to a server for processing and a response and a response time are received from the server. In response to determining one of 1) that the request count equals or exceeds a recalculation count and 2) that a time interval for recalculation has ended, a new dynamic throttling threshold is calculated using the response time and the current dynamic throttling threshold is set to the new dynamic throttling threshold. Then, the response is returned to the client. In response to determining that the request count is not less than the current dynamic throttling threshold, the request is throttled.