Efficient state maintenance for execution environments in an on-demand code execution system

    公开(公告)号:US11099917B2

    公开(公告)日:2021-08-24

    申请号:US16144905

    申请日:2018-09-27

    Abstract: Systems and methods are described for providing maintaining state information during processing of data sets via execution of code on an on-demand code execution system. Rather than requiring that execution environments of such a system to maintain state, an intermediary device is disclosed which retrieves calls to the system from a call queue and iteratively submits the calls to the system. Each call within the queue corresponds to a data item of the data set to be analyzed. As calls are submitted to the system, the intermediary device submits state information within the call reflecting a state of processing the data set. A response to the call includes state information updated based on processing of a data item in the call. Thus, state information is maintained for processing the data set, without requiring persistence of state information within individual execution environments.

    Message processing using messaging services

    公开(公告)号:US10999234B1

    公开(公告)日:2021-05-04

    申请号:US16518923

    申请日:2019-07-22

    Abstract: A message processing technology is provided that includes subscription of stateless compute functions to messaging queues of the message queueing service. The message queueing service may be configured to provide highly scalable hosted messaging queues for reliable delivery of messages. When messages are received in a messaging queue, then a stateless compute function, of a serverless compute service, that is subscribed to the messaging queue may be invoked to process the message. The serverless compute service manages compute resource for execution of the stateless compute function in response to dynamic message traffic.

    EXECUTION OF AUXILIARY FUNCTIONS IN AN ON-DEMAND NETWORK CODE EXECUTION SYSTEM

    公开(公告)号:US20210081233A1

    公开(公告)日:2021-03-18

    申请号:US17107663

    申请日:2020-11-30

    Abstract: Systems and methods are described for providing auxiliary functions in an on-demand code execution system in a manner that enables efficient execution of code. A user may generate a task on the system by submitting code. The system may determine the auxiliary functions that the submitted code may require when executed on the system, and may provide these auxiliary functions by provisioning or configuring sidecar virtualized execution environments that work in conjunction with the main virtualized execution environment executing the submitted code. Sidecar virtualized execution environments may be identified and obtained from a library of preconfigured sidecar virtualized execution environments, or a sidecar agent that provides the auxiliary function may be identified from a library, and then a virtualized execution environment may be provisioned with the agent and/or configured to work in conjunction with the main virtualized execution environment.

    Processing pre-existing data sets at an on demand code execution environment

    公开(公告)号:US10891145B2

    公开(公告)日:2021-01-12

    申请号:US15085902

    申请日:2016-03-30

    Abstract: Systems and methods are described for transforming a data set within a data source into a series of task calls to an on-demand code execution environment or other distributed code execution environment. Such environments utilize pre-initialized virtual machine instances to enable execution of user-specified code in a rapid manner, without delays typically caused by initialization of the virtual machine instances, and are often used to process data in near-real time, as it is created. However, limitations in computing resources may inhibit a user from utilizing an on-demand code execution environment to simultaneously process a large, existing data set. The present application provides a task generation system that can iteratively retrieve data items from an existing data set and generate corresponding task calls to the on-demand computing environment, while ensuring that at least one task call for each data item within the existing data set is made.

    Cross-environment application of tracing information for improved code execution

    公开(公告)号:US10884722B2

    公开(公告)日:2021-01-05

    申请号:US16872033

    申请日:2020-05-11

    Abstract: Systems and methods are described for enabling cross-environment application of tracing information for code, such as code executed within an on-demand (or “serverless”) code execution system. Various optimizations exist that allow execution of code to proceed faster or more efficiently over time, by collecting tracing information regarding the execution and using that tracing information to guide compilation of the code. These optimizations are typically designed for long-lived environments. However, executions within an on-demand code execution system often occur in short-lived environments, reducing or eliminating any gains from these optimizations. To address this issue, optimizations made in a first environment based on tracing information can be passed to a subsequent environment, enabling those optimizations to persist across short-lived environments.

    Execution of auxiliary functions in an on-demand network code execution system

    公开(公告)号:US10853115B2

    公开(公告)日:2020-12-01

    申请号:US16017954

    申请日:2018-06-25

    Abstract: Systems and methods are described for providing auxiliary functions in an on-demand code execution system in a manner that enables efficient execution of code. A user may generate a task on the system by submitting code. The system may determine the auxiliary functions that the submitted code may require when executed on the system, and may provide these auxiliary functions by provisioning sidecar virtual machine instances that work in conjunction with the virtual machine instance executing the submitted code. The sidecars may provide auxiliary functions on a per-task, per-user, or per-request basis, and the lifecycles of the sidecars may be determined based on the lifecycles of the virtual machine instances that execute submitted code. Auxiliary functions may thus be provided only when needed, and may be provided securely by preventing a user from accessing the sidecars of other users.

Patent Agency Ranking