公开(公告)号：US11474868B1

公开(公告)日：2022-10-18

申请号：US16698758

申请日：2019-11-27

Applicant: Amazon Technologies, Inc.

Inventor： Somar Musa ,  Jakub Wojciak ,  Bernardo Vecchia Stein ,  Shunjia Ding

IPC: G06F9/50 ,  G06Q30/02 ,  G06F9/52

Abstract: A shard polling system fairly distributes stored items from producers to consumer processes and includes polling threads that poll for items from respective portions of a storage source, place the items in respective queues, and increment a global permit counter, restricted to a configurable maximum, that tracks the quantity of messages across the respective queues. The polling threads are restricted by respective shard permit counters that limit a quantity of items that may be moved from a storage source to a respective queue. A global thread applies a fairness technique, such as round robin, to fairly obtain the items from each of the respective queues and places the items in a global queue, decrementing the global permit counter, and incrementing the respective shard permit counter for each item obtained. Consumer threads poll the global queue (e.g., a blocking output queue) for the messages.