公开(公告)号：US11457065B1

公开(公告)日：2022-09-27

申请号：US17033463

申请日：2020-09-25

Applicant: Amazon Technologies, Inc.

Inventor： Thomas Alexander McNicol ,  Fenil Shah

IPC: H04L67/1031 ,  H04L45/02 ,  H04L67/1036 ,  H04L67/1008 ,  H04L67/61

Abstract: A system for adjusting individual host rate limits based on a fleet-wide service rate limit and a fleet host count. The system includes a fleet of hosts for a service. Individual hosts of the fleet of hosts respectively include application logic, a host rate limiter to limit interactions between the application logic and another service according to a host rate limit for the individual host, and an adaptive rate component. The adaptive rate component updates a host entry in a host table to indicate a current heartbeat timestamp for the individual host. The adaptive rate component retrieves the fleet-wide service rate value and the fleet host count value. The adaptive rate component determines the host rate limit for the individual host based on the fleet-wide service rate value and the fleet host count value. The adaptive rate component provides the host rate limit to the host rate limiter.