公开(公告)号：US11968280B1

公开(公告)日：2024-04-23

申请号：US17456546

申请日：2021-11-24

Applicant: Amazon Technologies, Inc.

Inventor： Vinayak Sood ,  Mandakini Saroop ,  Shu Song ,  Tejas Mahadeo Ghadge ,  Tyson Charles Olychuck ,  Dinesh Saheblal Gupta ,  Jia Liu

IPC: G06F8/33 ,  G06F8/41 ,  H04L67/133 ,  H04L67/564 ,  H04L67/5651 ,  H04L67/60

CPC classification number: H04L67/60 ,  H04L67/133 ,  H04L67/564 ,  H04L67/5651

Abstract: Systems and methods are described controlling ingestion of data items within a data stream by executions of a serverless function on a serverless compute system. A poller device can act as an intermediary between the data stream and the serverless function, iteratively retrieving data items from the data stream and passing them in invocations of the serverless function. To allow for fine-grained control of ingestion without requiring implementation of complex logic at the poller device, the poller device can enable the serverless function to pass instructions controlling subsequent operation of the poller device. Each execution of the serverless function may determine whether subsequent operation of the poller device should be altered, and if so, instruct the poller device accordingly. The poller device can then modify its operation pursuant to the instructions, enabling highly granular control of streaming data ingestion without inhibiting existing benefits of serverless computing.

公开(公告)号：US11550505B1

公开(公告)日：2023-01-10

申请号：US17008998

申请日：2020-09-01

Applicant: Amazon Technologies, Inc.

Inventor： Dinesh Saheblal Gupta ,  Deepak Verma ,  Jiaxuan Lu

IPC: G06F3/06 ,  G06F9/38 ,  G06F9/48

Abstract: A data stream may include a plurality of records that are ordered, and the plurality of records may be assigned to a processing shard. A first set of virtual shards may be formed, the first set of virtual shards having a first quantity of virtual shards that perform parallel processing operations on behalf of the processing shard. First records of the plurality of records may be processed using the first set of virtual shards. The first quantity of virtual shards may be modified, based at least in part on an observed record age, to a second quantity of virtual shards that perform parallel processing operations on behalf of the processing shard. A second set of virtual shards may be formed having the second quantity of virtual shards. Second records of the plurality of records may be processed using the second set of virtual shards.

公开(公告)号：US11388210B1

公开(公告)日：2022-07-12

申请号：US17305139

申请日：2021-06-30

Applicant: Amazon Technologies, Inc.

Inventor： Vinayak Sood ,  Jia Liu ,  Mandakini Saroop ,  Tejas Mahadeo Ghadge ,  Himanshu Sharma ,  Nithin Vommi ,  Tyson Charles Olychuck ,  Dinesh Saheblal Gupta ,  Peng Sun

IPC: H04L29/06 ,  H04L65/61 ,  H04L67/567 ,  H04L67/566 ,  H04L65/65

Abstract: Systems and methods are described implementing streaming analytics on a serverless compute system. A user can specify a data stream against which analytics should be conducted, serverless functions to be used to conduct the analysis, and criteria for the analytics, such as windowing criteria and aggregation criteria. The windowing criteria can specify windows of items within the stream that should be collectively analyzed. The aggregation criteria can specify how to group items within each window during analysis. A poller device can read data items from the stream, window and group the items according to the windowing and aggregation criteria, and invoke serverless functions to conduct streaming analytics on the data items. The poller device can further maintain state between invocations.