公开(公告)号：US10942795B1

公开(公告)日：2021-03-09

申请号：US16698829

申请日：2019-11-27

Applicant: Amazon Technologies, Inc.

Inventor： David Yanacek ,  Sean Tyler Myers ,  Yogesh Aggarwal ,  Naveen Dasa Subramanyam ,  Amit Raghunath Kulkarni ,  Aritra Bandyopadhyay ,  Jianwei Cui

IPC: G06F9/54 ,  G06F16/22

Abstract: Systems and methods are described for reducing cold starts code within a serverless code execution system by providing a set of environments reserved for the code. A frontend utilizes a consistent hash ring to distribute calls for execution among a set of manager devices that manage environments in the system, distributed in a manner that groups calls together and attempts to distribute calls of the same group to a stable subset of the manager devices. Each group is assigned an arc, representing a subset of manager devices. When a call is received to execute a set of code that has environments reserved, the frontend distributes the call to a manager device of a reserved arc. When a call is received to execute a set of code that does not have environment reserved, the frontend distributes the call to an arc associated with an arc for unreserved executions.

公开(公告)号：US20210157645A1

公开(公告)日：2021-05-27

申请号：US16698845

申请日：2019-11-27

Applicant: Amazon Technologies, Inc.

Inventor： David Yanacek ,  Sean Tyler Myers ,  Yogesh Aggarwal ,  Naveen Dasa Subramanyam ,  Amit Raghunath Kulkarni ,  Aritra Bandyopadhyay ,  Jianwei Cui

IPC: G06F9/50

Abstract: Systems and methods are described for reducing cold starts code within a serverless code execution system by providing a set of environments reserved for the code. A frontend distribute calls for execution among a set of manager devices that manage environments in the system, distributed in a manner that groups calls together and attempts to distribute calls of the same group to a stable subset of the manager devices. In the case that a user reduces or eliminates the number of environments reserved for the code, a frontend continues to distribute calls for execution of the code to those environments while they continue to be used. This reduces cold starts that might otherwise occur during reduction or elimination of reserved environments.

公开(公告)号：US11119826B2

公开(公告)日：2021-09-14

申请号：US16698845

申请日：2019-11-27

Applicant: Amazon Technologies, Inc.

Inventor： David Yanacek ,  Sean Tyler Myers ,  Yogesh Aggarwal ,  Naveen Dasa Subramanyam ,  Amit Raghunath Kulkarni ,  Aritra Bandyopadhyay ,  Jianwei Cui

IPC: G06F9/46 ,  G06F9/50

Abstract: Systems and methods are described for reducing cold starts code within a serverless code execution system by providing a set of environments reserved for the code. A frontend distribute calls for execution among a set of manager devices that manage environments in the system, distributed in a manner that groups calls together and attempts to distribute calls of the same group to a stable subset of the manager devices. In the case that a user reduces or eliminates the number of environments reserved for the code, a frontend continues to distribute calls for execution of the code to those environments while they continue to be used. This reduces cold starts that might otherwise occur during reduction or elimination of reserved environments.