METHOD AND SYSTEM FOR CLUSTER RATE LIMITING IN A CLOUD COMPUTING SYSTEM

    公开(公告)号:US20200028788A1

    公开(公告)日:2020-01-23

    申请号:US16038826

    申请日:2018-07-18

    Abstract: Systems and methods for rate limiting one or more clusters of service instances using at least one rate limit controller are described herein. A token distribution is determined for each one of a plurality of rate limiters. The token distribution comprising a maximum number of tokens and a token generating rate. The maximum number of tokens and the token generating rate are assigned to each one of the plurality of rate limiters. At least one request for additional tokens is received from at least a given one of the plurality of rate limiters. The token distribution of at least the given one of the plurality of rate limiters is adjusted based on the request and on token consumption information of at least the given one of the plurality of rate limiters. An adjusted token distribution is assigned to the given one of the plurality of rate limiters.

    Method and system for cluster rate limiting in a cloud computing system

    公开(公告)号:US10951532B2

    公开(公告)日:2021-03-16

    申请号:US16038826

    申请日:2018-07-18

    Abstract: Systems and methods for rate limiting one or more clusters of service instances using at least one rate limit controller are described herein. A token distribution is determined for each one of a plurality of rate limiters. The token distribution comprising a maximum number of tokens and a token generating rate. The maximum number of tokens and the token generating rate are assigned to each one of the plurality of rate limiters. At least one request for additional tokens is received from at least a given one of the plurality of rate limiters. The token distribution of at least the given one of the plurality of rate limiters is adjusted based on the request and on token consumption information of at least the given one of the plurality of rate limiters. An adjusted token distribution is assigned to the given one of the plurality of rate limiters.

Patent Agency Ranking