-
公开(公告)号:US20210263658A1
公开(公告)日:2021-08-26
申请号:US17319020
申请日:2021-05-12
Applicant: Amazon Technologies, Inc.
Inventor: Norbert Paul Kusters , Nachiappan Arumugam , Andre Podnozov , Shobha Agrawal , Shreyas Ramalingam , Danny Wei , David R. Richardson , Marc John Brooker , Christopher Nathan Watson , John Luther Guthrie, II , Ravi Nankani
Abstract: A data storage system includes a head node and mass storage devices. The head node is configured to flush data stored in a storage of the head node to a set of the mass storage devices of the data storage system. A head node may flush both current version data and point-in-time version data to the set of mass storage devices. Also, the data storage system maintains an index that indicates storage locations of data for particular portions of a volume before and after the data is flushed to the set of mass storage devices. In some embodiments an index includes a current version reference for a volume or portion of a volume and one or more point-in-time snapshot references.
-
42.
公开(公告)号:US11099917B2
公开(公告)日:2021-08-24
申请号:US16144905
申请日:2018-09-27
Applicant: Amazon Technologies, Inc.
Inventor: Hans-Philipp Anton Hussels , Timothy Allen Wagner , Marc John Brooker
Abstract: Systems and methods are described for providing maintaining state information during processing of data sets via execution of code on an on-demand code execution system. Rather than requiring that execution environments of such a system to maintain state, an intermediary device is disclosed which retrieves calls to the system from a call queue and iteratively submits the calls to the system. Each call within the queue corresponds to a data item of the data set to be analyzed. As calls are submitted to the system, the intermediary device submits state information within the call reflecting a state of processing the data set. A response to the call includes state information updated based on processing of a data item in the call. Thus, state information is maintained for processing the data set, without requiring persistence of state information within individual execution environments.
-
公开(公告)号:US11010064B2
公开(公告)日:2021-05-18
申请号:US15433956
申请日:2017-02-15
Applicant: Amazon Technologies, Inc.
Inventor: Norbert Paul Kusters , Nachiappan Arumugam , Andre Podnozov , Shobha Agrawal , Shreyas Ramalingam , Danny Wei , David R. Richardson , Marc John Brooker , Christopher Nathan Watson , John Luther Guthrie, II , Ravi Nankani
Abstract: A data storage system includes a head node and mass storage devices. The head node is configured to flush data stored in a storage of the head node to a set of the mass storage devices of the data storage system. A head node may flush both current version data and point-in-time version data to the set of mass storage devices. Also, the data storage system maintains an index that indicates storage locations of data for particular portions of a volume before and after the data is flushed to the set of mass storage devices. In some embodiments an index includes a current version reference for a volume or portion of a volume and one or more point-in-time snapshot references.
-
公开(公告)号:US10999234B1
公开(公告)日:2021-05-04
申请号:US16518923
申请日:2019-07-22
Applicant: Amazon Technologies, Inc.
Inventor: Petr Shveykin , Jakub Wojciak , Marc John Brooker , Cecilia Deng
Abstract: A message processing technology is provided that includes subscription of stateless compute functions to messaging queues of the message queueing service. The message queueing service may be configured to provide highly scalable hosted messaging queues for reliable delivery of messages. When messages are received in a messaging queue, then a stateless compute function, of a serverless compute service, that is subscribed to the messaging queue may be invoked to process the message. The serverless compute service manages compute resource for execution of the stateless compute function in response to dynamic message traffic.
-
公开(公告)号:US20210081233A1
公开(公告)日:2021-03-18
申请号:US17107663
申请日:2020-11-30
Applicant: Amazon Technologies, Inc.
Inventor: Niall Mullen , Philip Daniel Piwonka , Timothy Allen Wagner , Marc John Brooker
Abstract: Systems and methods are described for providing auxiliary functions in an on-demand code execution system in a manner that enables efficient execution of code. A user may generate a task on the system by submitting code. The system may determine the auxiliary functions that the submitted code may require when executed on the system, and may provide these auxiliary functions by provisioning or configuring sidecar virtualized execution environments that work in conjunction with the main virtualized execution environment executing the submitted code. Sidecar virtualized execution environments may be identified and obtained from a library of preconfigured sidecar virtualized execution environments, or a sidecar agent that provides the auxiliary function may be identified from a library, and then a virtualized execution environment may be provisioned with the agent and/or configured to work in conjunction with the main virtualized execution environment.
-
公开(公告)号:US10924543B1
公开(公告)日:2021-02-16
申请号:US14975603
申请日:2015-12-18
Applicant: Amazon Technologies, Inc.
Inventor: Tao Chen , Marc John Brooker , Divya Ashok Kumar Jain , Lakshmi N. Pallikila , Shobha Agrawal
Abstract: Data replication groups may be used to store data in a distributed computing environment. The data replication groups may include a set of nodes executing a consensus protocol to maintain data durably. The nodes may be executed by one or more host computer systems. In order to avoid failure of the data replication groups as safe deployment strategy is provided. The one or more host computer systems may be assigned to deployment groups where the number of hosts assigned to the deployment groups host less than a quorum of the nodes of a particular data replication group.
-
公开(公告)号:US10891145B2
公开(公告)日:2021-01-12
申请号:US15085902
申请日:2016-03-30
Applicant: Amazon Technologies, Inc.
Inventor: Timothy Allen Wagner , Marc John Brooker , Ajay Nair
IPC: G06F12/08 , G06F9/455 , G06F12/0875
Abstract: Systems and methods are described for transforming a data set within a data source into a series of task calls to an on-demand code execution environment or other distributed code execution environment. Such environments utilize pre-initialized virtual machine instances to enable execution of user-specified code in a rapid manner, without delays typically caused by initialization of the virtual machine instances, and are often used to process data in near-real time, as it is created. However, limitations in computing resources may inhibit a user from utilizing an on-demand code execution environment to simultaneously process a large, existing data set. The present application provides a task generation system that can iteratively retrieve data items from an existing data set and generate corresponding task calls to the on-demand computing environment, while ensuring that at least one task call for each data item within the existing data set is made.
-
公开(公告)号:US10884722B2
公开(公告)日:2021-01-05
申请号:US16872033
申请日:2020-05-11
Applicant: Amazon Technologies, Inc.
Inventor: Marc John Brooker , Mikhail Danilov , Tobias Holgers
Abstract: Systems and methods are described for enabling cross-environment application of tracing information for code, such as code executed within an on-demand (or “serverless”) code execution system. Various optimizations exist that allow execution of code to proceed faster or more efficiently over time, by collecting tracing information regarding the execution and using that tracing information to guide compilation of the code. These optimizations are typically designed for long-lived environments. However, executions within an on-demand code execution system often occur in short-lived environments, reducing or eliminating any gains from these optimizations. To address this issue, optimizations made in a first environment based on tracing information can be passed to a subsequent environment, enabling those optimizations to persist across short-lived environments.
-
公开(公告)号:US10853115B2
公开(公告)日:2020-12-01
申请号:US16017954
申请日:2018-06-25
Applicant: Amazon Technologies, Inc.
Inventor: Niall Mullen , Philip Daniel Piwonka , Timothy Allen Wagner , Marc John Brooker
Abstract: Systems and methods are described for providing auxiliary functions in an on-demand code execution system in a manner that enables efficient execution of code. A user may generate a task on the system by submitting code. The system may determine the auxiliary functions that the submitted code may require when executed on the system, and may provide these auxiliary functions by provisioning sidecar virtual machine instances that work in conjunction with the virtual machine instance executing the submitted code. The sidecars may provide auxiliary functions on a per-task, per-user, or per-request basis, and the lifecycles of the sidecars may be determined based on the lifecycles of the virtual machine instances that execute submitted code. Auxiliary functions may thus be provided only when needed, and may be provided securely by preventing a user from accessing the sidecars of other users.
-
公开(公告)号:US10809920B1
公开(公告)日:2020-10-20
申请号:US15385814
申请日:2016-12-20
Applicant: Amazon Technologies, Inc.
Inventor: Marc Stephen Olson , Christopher Magee Greenwood , Anthony Nicholas Liguori , James Michael Thompson , Surya Prakash Dhoolam , Marc John Brooker , Danny Wei
Abstract: First information about regions of storage space in a storage environment available for a volume is provided to a service provider, with the storage environment being external to the service provider. The service provider is notified that information usable to locate a storage destination of a portion of the volume is unavailable. Second information that includes the storage destination in the storage environment is obtained from the service provider. A data operation is performed at the storage destination, with the storage destination determined based at least in part from the second information.
-
-
-
-
-
-
-
-
-