-
公开(公告)号:US20170147243A1
公开(公告)日:2017-05-25
申请号:US15425857
申请日:2017-02-06
Applicant: Amazon Technologies, Inc.
Inventor: Marcin Piotr Kowalski , David R. Richardson , James Alfred Gordon Greenfield , Jacobus Johannes Nicolaas Van Der Merwe , Matthew James Eddey , Christopher Richard Jacques De Kadt , Peter Nicholas Desantis
IPC: G06F3/06
CPC classification number: G06F3/0619 , G06F3/0604 , G06F3/065 , G06F3/0664 , G06F3/0665 , G06F3/067 , G06F3/0673 , G06F3/0689
Abstract: Methods and apparatus for profile-guided preloading for virtualized resources are described. A block-level storage volume whose contents are to be populated via data transfers from a repository service is programmatically attached to a compute instance. An indication of data transfers from the repository to a block storage service implementing the volume is obtained, corresponding to a particular phase of program execution at the compute instance. A storage profile is generated, based at least in part on the indication of data transfers. The storage profile is subsequently used to pre-load data from the repository service on behalf of other compute instances.
-
公开(公告)号:US11609890B1
公开(公告)日:2023-03-21
申请号:US14753475
申请日:2015-06-29
Applicant: Amazon Technologies, Inc.
Inventor: Allan Henry Vermeulen , Timothy Daniel Cole , John Michael Morkel , Christopher Richard Jacques De Kadt , Artem Danilov , Andrew Wayne Ross
IPC: G06F16/28 , G06F16/21 , G06F16/951
Abstract: A transaction request compliant with a first version of a journal schema of a multi-data-store storage system is received at a journal manager. The journal schema indicates attributes of data objects which may be materialized at various data stores of the system. The journal manager stores an entry in the system's journal if the transaction meets acceptance criteria. Writes indicated in the entry are materialized at the data stores after verifying that the entry is compliant with the journal schema. After verifying that member data stores have approved a proposed change to the journal schema, another entry indicating a different version of the journal schema is added to the journal. Client-side components of the system obtain the current version of the journal schema to prepare the transaction requests.
-
公开(公告)号:US10348814B1
公开(公告)日:2019-07-09
申请号:US14134475
申请日:2013-12-19
Applicant: Amazon Technologies, Inc.
Inventor: Robin Alan Golden , Marc Andrew Bowes , John Michael Morkel , Christopher Richard Jacques De Kadt
Abstract: Systems with multiple components managing storage may implement efficient storage reclamation. A storage reclamation event may be detected for a system component. An indication to a request dispatching mechanism may be made which indicates that the system component is unable to perform further tasks in order to perform storage reclamation. A storage reclamation operation, such as a stop-the-world garbage collection technique, or a service process restart may be performed to reclaim at least some storage. Upon completion of the storage reclamation operation, an indication may be made to the request distribution mechanism that the service process has resumed performing tasks for the system. In some embodiments, a gossip protocol communicating availability information to different nodes of a distributed system may provide information to schedule storage reclamation operations at different compute nodes of the distributed system.
-
公开(公告)号:US10331657B1
公开(公告)日:2019-06-25
申请号:US14868267
申请日:2015-09-28
Applicant: Amazon Technologies, Inc.
Inventor: Timothy Daniel Cole , Artem Danilov , Andrew Wayne Ross , John Michael Morkel , Tate Andrew Certain , Allan Henry Vermeulen , Christopher Richard Jacques De Kadt
IPC: G06F16/30 , G06F16/23 , G06F16/901 , G06F16/2453 , G06F16/2455
Abstract: An analytics tool of a journal-based multi-data-store database obtains respective rejection cause descriptors for a set of transactions rejected by the journal manager of the database due to read-write conflicts. A particular rejection cause descriptor indicates a query predicate used for a read set of a transaction request which was rejected by a journal manager of the database due to a read-write conflict between the read set and a previously-committed transaction. The analytics tool prepares a database contention analysis using the rejection cause descriptors, and transmits the analysis to a client.
-
公开(公告)号:US09990391B1
公开(公告)日:2018-06-05
申请号:US14833001
申请日:2015-08-21
Applicant: Amazon Technologies, Inc.
Inventor: Timothy Daniel Cole , John Michael Morkel , Christopher Richard Jacques De Kadt , Artem Danilov , Allan Henry Vermeulen , Tate Andrew Certain , Andrew Wayne Ross
CPC classification number: G06F17/30371 , G06F17/30383 , G06F17/30578
Abstract: A journal manager of a multi-data-store storage system receives a transaction which includes a message to be stored in the storage system's journal if the transaction request is accepted for commit. The journal manager performs a conflict detection operation, accepts the transaction request, and stores a corresponding committed transaction entry including the message in the journal. A write applier associated with a registered materialization node of the journal reads the committed transaction entry and applies a write indicated in the entry. A registered message subscriber of the journal reads the committed transaction entry asynchronously with respect to the write applier, and reads the contents of the message without applying the write.
-
公开(公告)号:US09385963B1
公开(公告)日:2016-07-05
申请号:US13958660
申请日:2013-08-05
Applicant: Amazon Technologies, Inc.
IPC: H04L12/26 , H04L12/911
CPC classification number: H04L47/70 , H04L12/4641 , H04L67/02 , H04L67/32
Abstract: A system for allocating constrained resources (e.g., downstream services, execution threads, database connections, input/output channels, computational resources, and/or memory) to requested services that are dependent on those resources may include multiple resource queues, each of which maintains a queue of requests for a respective constrained resource, and multiple service request queues, from which requests may be subsequently serviced. As each request reaches the head of a resource queue, it may receive a resource token for a respective constrained resource. Once the request has collected resource tokens for each of the constrained resources on which it depends, the request may be passed to a service request queue that maintains a queue of requests of a particular type. Requests in the multiple service request queues may be serviced on a round-robin or weighted round-robin basis. The number of tokens available for each constrained resource may be modified based on observed system performance.
-
公开(公告)号:US09374417B1
公开(公告)日:2016-06-21
申请号:US14288224
申请日:2014-05-27
Applicant: Amazon Technologies, Inc.
Inventor: James Alfred Gordon Greenfield , Dirk Gerhardes Oberholster , Christopher Richard Jacques De Kadt
IPC: G06F15/16 , H04L29/08 , G06F15/177
CPC classification number: H04L67/10 , G06F9/45533 , G06F11/0709 , G06F11/0712 , G06F11/0751 , G06F11/0787 , G06F11/30 , G06F15/177 , G06F21/577 , G06F2221/2101 , H04L63/1408
Abstract: A distributed system may implement dynamic specification auditing. A specification for a distributed system may be maintained in a machine readable format. Specification assertion agents corresponding to different components of the distributed system may request and receive the specification in order to verify whether tasks performed by the respective component satisfy the specification. The specification assertion agents may then send assertions of the success or failure of the component to be stored in order to verify compliance with specification. Various reports may be generated which identify failures or components in the distributed system that are not reporting assertions.
Abstract translation: 分布式系统可以实现动态规范审计。 可以以机器可读格式维护分布式系统的规范。 对应于分布式系统的不同组件的规范断言代理可以请求和接收规范,以便验证由相应组件执行的任务是否满足规范。 然后,规范断言代理可以发送要存储的组件的成功或失败的断言,以便验证是否符合规范。 可能会生成各种报告,用于识别分布式系统中不报告断言的故障或组件。
-
公开(公告)号:US11995066B2
公开(公告)日:2024-05-28
申请号:US17664375
申请日:2022-05-20
Applicant: Amazon Technologies, Inc.
IPC: G06F16/23 , G06F16/28 , G06F16/901
CPC classification number: G06F16/2365 , G06F16/2358 , G06F16/2379 , G06F16/282 , G06F16/9024
Abstract: At a logging service, a representation of a transaction requested by a client is received. The transaction includes at least a first write operation directed to a data object at a first data store. Based at least in part on the contents of the representation and contents of a persistent log of the logging service, a determination is made that the requested transaction is to be committed. A log record corresponding to the first write operation is inserted into the persistent log. The first write is propagated to the first data store after the record has been inserted in the persistent log.
-
公开(公告)号:US11599520B1
公开(公告)日:2023-03-07
申请号:US14753505
申请日:2015-06-29
Applicant: Amazon Technologies, Inc.
Inventor: Allan Henry Vermeulen , Timothy Daniel Cole , John Michael Morkel , Christopher Richard Jacques De Kadt , Artem Danilov , Andrew Wayne Ross
IPC: G06F16/245 , G06F16/23 , G06F9/46 , G06F16/22
Abstract: A query restriction descriptor indicating one or more attributes of a data object of a multi-data-store storage system is determined at a client-side component of the system. The query restrictions descriptor is used to prepare at least a read set descriptor of a proposed transaction. The read set of the proposed transaction includes a query with a predicate directed to the one or more attributes. A transformation function is applied to the predicate, and the result of the transformation is included in the read set descriptor. The proposed transaction is sent to a journal manager of the system, which performs read-write conflict detection using the read set descriptor and write set descriptors of one or more previously-committed transactions.
-
公开(公告)号:US10698767B1
公开(公告)日:2020-06-30
申请号:US14579742
申请日:2014-12-22
Applicant: Amazon Technologies, Inc.
Inventor: Christopher Richard Jacques De Kadt , Marc Andrew Bowes , Jacobus Johannes Van Der Merwe , Andrew James Lusk , Jacob Adam Gabrielson , Robin Alan Golden , Michael Groenewald , James Alfred Gordon Greenfield
Abstract: A service workflow agent associated with a particular service of a provider network identifies a repository in which workflow descriptors indicative of tasks to be performed by the service are stored. In response to determining that a modification has been applied at one such repository, the agent examines a particular workflow descriptor stored in the repository. The agent initiates an attempt to implement a first task indicated in the descriptor. Subsequently, the agent updates the descriptor in accordance with an optimistic concurrency control technique to indicate a status of the first task.
-
-
-
-
-
-
-
-
-