METHOD AND SYSTEM FOR CLUSTER RATE LIMITING IN A CLOUD COMPUTING SYSTEM

    公开(公告)号:US20200028788A1

    公开(公告)日:2020-01-23

    申请号:US16038826

    申请日:2018-07-18

    Abstract: Systems and methods for rate limiting one or more clusters of service instances using at least one rate limit controller are described herein. A token distribution is determined for each one of a plurality of rate limiters. The token distribution comprising a maximum number of tokens and a token generating rate. The maximum number of tokens and the token generating rate are assigned to each one of the plurality of rate limiters. At least one request for additional tokens is received from at least a given one of the plurality of rate limiters. The token distribution of at least the given one of the plurality of rate limiters is adjusted based on the request and on token consumption information of at least the given one of the plurality of rate limiters. An adjusted token distribution is assigned to the given one of the plurality of rate limiters.

    System and Method to Schedule Management Operations and Shared Memory Space for Multi-tenant Cache Service in Cloud

    公开(公告)号:US20200344110A1

    公开(公告)日:2020-10-29

    申请号:US16920841

    申请日:2020-07-06

    Abstract: Systems and methods for controlling management operations and shared memory space are disclosed. A cloud cache management controller may receive multiple sets of service attributes. Each set of the multiple sets of service attributes may be related to a cloud cache service instance. The cloud cache management controller may receive a first cloud cache management request. The cloud cache management request may comprise a cloud cache management operation. The cloud cache management controller may retrieve a set of service attributes from the multiple sets of service attributes based on an evaluation of the cloud cache management operation. The cloud cache management controller may send the first cloud cache management request to a corresponding CCSI based on a priority value for the first cloud cache management request calculated based on the retrieved set of service attributes.

    Method and system for cluster rate limiting in a cloud computing system

    公开(公告)号:US10951532B2

    公开(公告)日:2021-03-16

    申请号:US16038826

    申请日:2018-07-18

    Abstract: Systems and methods for rate limiting one or more clusters of service instances using at least one rate limit controller are described herein. A token distribution is determined for each one of a plurality of rate limiters. The token distribution comprising a maximum number of tokens and a token generating rate. The maximum number of tokens and the token generating rate are assigned to each one of the plurality of rate limiters. At least one request for additional tokens is received from at least a given one of the plurality of rate limiters. The token distribution of at least the given one of the plurality of rate limiters is adjusted based on the request and on token consumption information of at least the given one of the plurality of rate limiters. An adjusted token distribution is assigned to the given one of the plurality of rate limiters.

Patent Agency Ranking