-
公开(公告)号:US10956399B1
公开(公告)日:2021-03-23
申请号:US15199852
申请日:2016-06-30
Applicant: Amazon Technologies, Inc.
Inventor: Timothy Daniel Cole , John Michael Morkel , Allan Henry Vermeulen , Christopher Richard Jacques de Kadt
Abstract: A journaled database may comprise a computing node that forms a local version of a global state, synchronized with respect to the high-water mark of a data node that maintains the global state. Instructions to modify the state that have been committed, subsequent to forming the local version of the state, may be represented in a merge signature. An uncommitted transaction may be checked for conflicts with respect to a last-ordered committed instruction to modify the data state. Validation with respect to earlier instructions represented by the merge signature may be skipped.
-
公开(公告)号:US10423459B1
公开(公告)日:2019-09-24
申请号:US15275302
申请日:2016-09-23
Applicant: Amazon Technologies, Inc.
Inventor: Christopher Richard Jacques de Kadt , Benjamin Warren Mercier , Carlos Vara Callau , Timothy Daniel Cole , Aaron Gifford Freshwater , Sayantan Chakravorty , Allan Henry Vermeulen
Abstract: A resource manager arranges the resources in a computer system into one or more resource pools. The resource manager allocates a number of active resources and a number of backup resources to a particular resource pool. For each resource managed by the resource manager, the resource manager acquires information that describes the capacity and reliability of the resource. Capacity and reliability information for the particular resource pool is determined based on the capacity and reliability information associated with the resources assigned to the pool. In response to a request, the resource manager may provide an application with resources from several resource pools. The likelihood that the resource manager will be able to provide sufficient resources to the application may be determined based at least in part on the reliability information associated with the several resource pools.
-
公开(公告)号:US10346366B1
公开(公告)日:2019-07-09
申请号:US15275307
申请日:2016-09-23
Applicant: Amazon Technologies, Inc.
Inventor: Christopher Richard Jacques de Kadt , Benjamin Warren Mercier , Carlos Vara Callau , Timothy Daniel Cole , Aaron Gifford Freshwater , Sayantan Chakravorty , Allan Henry Vermeulen
Abstract: A pipeline management service improves the operation of a processing pipeline by monitoring the operation of one or more journal services within the processing pipeline, and adjusting operational parameters of the one or more journal services. In various examples, the pipeline management service determines a model of the processing pipeline by identifying the producers and consumers associated with each of the one or more journal services, and determines a processing flow through the one or more journal services based at least in part on the identities of the associated producers and consumers. The pipeline management service acquires backlog information from each of the one or more journal services, and may adjust the operational parameters of a journal service associated with an identified processing bottleneck. In some examples, the pipeline management service adjusts capacity and reliability parameters of the one or more journal services to improve the operation of the processing pipeline.
-
公开(公告)号:US20180260411A1
公开(公告)日:2018-09-13
申请号:US15979291
申请日:2018-05-14
Applicant: Amazon Technologies, Inc.
Inventor: Michael Benjamin Deardeuff , Timothy Daniel Cole , Aaron Gifford Freshwater , Allan Henry Vermeulen
CPC classification number: G06F16/1815 , G06F9/466
Abstract: A transaction request is received at a journal-based state management system. The transaction request includes a register processing section indicating an operation to be performed at a journal register allocated to the transaction submitter to store state information of an application. Based on the results of a conflict detection operation performed with respect to the transaction request and on the result of the operation on the journal register, the transaction request is accepted for commit. The value of the journal register is stored at a node of the state management system and provided to the transaction submitter.
-
公开(公告)号:US10031935B1
公开(公告)日:2018-07-24
申请号:US14833003
申请日:2015-08-21
Applicant: Amazon Technologies, Inc.
Inventor: Timothy Daniel Cole , John Michael Morkel , Tate Andrew Certain , Christopher Richard Jacques De Kadt , Artem Danilov , Andrew Wayne Ross , Allan Henry Vermeulen
Abstract: A materialization configuration request is received via a programmatic interface from a client of a journal-based multi-data-store database. The request indicates a partitioning rule to be used to select, for respective writes indicated in committed transaction entries of a journal, the materialization node at which the writes are to be stored. A control plane component of the database verifies that a set of materialization nodes corresponding to the partitioning rule has been established, and initiates the propagation of writes from the journal to the materialization nodes by respective write appliers.
-
公开(公告)号:US09971822B1
公开(公告)日:2018-05-15
申请号:US14983237
申请日:2015-12-29
Applicant: Amazon Technologies, Inc.
Inventor: Michael Benjamin Deardeuff , Timothy Daniel Cole , Aaron Gifford Freshwater , Allan Henry Vermeulen
CPC classification number: G06F17/30191 , G06F9/466 , G06F9/467
Abstract: A transaction request is received at a journal-based state management system. The transaction request includes a register processing section indicating an operation to be performed at a journal register allocated to the transaction submitter to store state information of an application. Based on the results of a conflict detection operation performed with respect to the transaction request and on the result of the operation on the journal register, the transaction request is accepted for commit. The value of the journal register is stored at a node of the state management system and provided to the transaction submitter.
-
公开(公告)号:US09519674B2
公开(公告)日:2016-12-13
申请号:US14482661
申请日:2014-09-10
Applicant: Amazon Technologies, Inc.
Inventor: Allan Henry Vermeulen , Timothy Andrew Rath , Timothy Daniel Cole , Kiran-Kumar Muniswamy-Reddy
IPC: G06F17/30
CPC classification number: G06F17/30283 , G06F17/30348 , G06F17/30353 , G06F17/30368 , G06F17/30377 , G06F17/30545 , G06F17/30578 , G06F17/30958
Abstract: At a client-side component of a storage group, a read descriptor generated in response to a read request directed to a first data store is received. The read descriptor includes a state transition indicator corresponding to a write that has been applied at the first data store. A write descriptor indicative of a write that depends on a result of the read request is generated at the client-side component. The read descriptor and the write descriptor are included in a commit request for a candidate transaction at the client-side component, and transmitted to a transaction manager.
Abstract translation: 在存储组的客户端组件中,接收响应于针对第一数据存储的读请求而生成的读描述符。 读取描述符包括与在第一数据存储处应用的写入相对应的状态转换指示符。 在客户端组件处产生指示取决于读取请求的结果的写入的写入描述符。 读取描述符和写描述符被包括在客户端组件的候选事务的提交请求中,并被发送到事务管理器。
-
公开(公告)号:US09323569B2
公开(公告)日:2016-04-26
申请号:US14482677
申请日:2014-09-10
Applicant: Amazon Technologies, Inc.
Inventor: Allan Henry Vermeulen , Parikshit S Pol , Timothy Andrew Rath , Timothy Daniel Cole
CPC classification number: G06F9/466
Abstract: A first transaction manager of a partitioned storage group stores a first conditional commit record for a first write of a multi-partition transaction based on a first conflict detection operation. A second transaction manager stores a second conditional commit record for a second write of the transaction based on a second conflict detection operation. A client-side component of the storage group determines that both writes have been conditionally committed, and stores an unconditional commit record in a commit decision repository. A write applier examines the first conditional commit record and the unconditional commit record before propagating the first write to the first partition.
Abstract translation: 分区存储组的第一事务管理器基于第一冲突检测操作存储用于多分区事务的第一写入的第一条件提交记录。 第二事务管理器基于第二冲突检测操作来存储用于事务的第二写入的第二条件提交记录。 存储组的客户端组件确定两个写入都已有条件地提交,并在提交决策存储库中存储无条件提交记录。 写入应用程序在将第一个写入传播到第一个分区之前检查第一个条件提交记录和无条件提交记录。
-
公开(公告)号:US12050561B2
公开(公告)日:2024-07-30
申请号:US16221212
申请日:2018-12-14
Applicant: Amazon Technologies, Inc.
Inventor: Timothy Daniel Cole , John Michael Morkel , Yevgeniy Mikhaylyuta , Allan Henry Vermeulen , Christopher Richard Jacques de Kadt
CPC classification number: G06F16/211 , G06F16/1815 , G06F16/213 , G06F16/219 , G06F16/2358
Abstract: A journaled database system may comprise data nodes that maintain a collection of data structured in accordance with a schema. A change to the schema may be applied by a journal module while a journal consumer continues to operate using a prior version of the schema. A buffer may be formed and have stored therein records describing state change instructions according to the prior view of the schema. An index of correspondence between the records in the buffer and in the source journal may be maintained.
-
公开(公告)号:US20240211461A1
公开(公告)日:2024-06-27
申请号:US18601916
申请日:2024-03-11
Applicant: Amazon Technologies, Inc.
Inventor: Timothy Daniel Cole , John Michael Morkel , Tate Andrew Certain , Christopher Richard Jacques de Kadt , Artem Danilov , Andrew Wayne Ross , Allan Henry Vermeulen
CPC classification number: G06F16/2315 , G06F16/2372 , G06F16/2393 , G06F16/27 , G06F16/278 , G06F16/284
Abstract: A materialization configuration request is received via a programmatic interface from a client of a journal-based multi-data-store database. The request indicates a partitioning rule to be used to select, for respective writes indicated in committed transaction entries of a journal, the materialization node at which the writes are to be stored. A control plane component of the database verifies that a set of materialization nodes corresponding to the partitioning rule has been established, and initiates the propagation of writes from the journal to the materialization nodes by respective write appliers.
-
-
-
-
-
-
-
-
-