公开(公告)号：US12099486B2

公开(公告)日：2024-09-24

申请号：US18186097

申请日：2023-03-17

Applicant: Amazon Technologies, Inc.

Inventor： Allan Henry Vermeulen ,  Timothy Daniel Cole ,  John Michael Morkel ,  Christopher Richard Jacques De Kadt ,  Artem Danilov ,  Andrew Wayne Ross ,  Tate Andrew Certain

IPC: G06F16/21 ,  G06F16/28 ,  G06F16/951

CPC classification number: G06F16/219 ,  G06F16/283 ,  G06F16/951

Abstract: A transaction request compliant with a first version of a journal schema of a multi-data-store storage system is received at a journal manager. The journal schema indicates attributes of data objects which may be materialized at various data stores of the system. The journal manager stores an entry in the system's journal if the transaction meets acceptance criteria. Writes indicated in the entry are materialized at the data stores after verifying that the entry is compliant with the journal schema. After verifying that member data stores have approved a proposed change to the journal schema, another entry indicating a different version of the journal schema is added to the journal. Client-side components of the system obtain the current version of the journal schema to prepare the transaction requests.

公开(公告)号：US10805238B1

公开(公告)日：2020-10-13

申请号：US15275300

申请日：2016-09-23

Applicant: Amazon Technologies, Inc.

Inventor： Christopher Richard Jacques de Kadt ,  Benjamin Warren Mercier ,  Carlos Vara Callau ,  Timothy Daniel Cole ,  Aaron Gifford Freshwater ,  Sayantan Chakravorty ,  Allan Henry Vermeulen

IPC: H04L12/911 ,  H04L29/08

Abstract: A journal service maintains a journal that holds a number of journal entries. Access to the journal entries is controlled by providing a lead resource with access to a named role associated with the journal. A pool of alternate resources containing potential replacements for the lead resource is maintained. A succession order may be established for the pool of alternate resources, and individual resources in the pool of alternate resources may be managed based at least in part on their position within the succession order. The succession order may be established using various criteria that are indicative of a likelihood that a particular alternate resource will be available if the lead resource fails, such as the presence of shared points of failure between the current lead resource and an alternate resource. The lead resource may be replaced with an alternate resource as a result of various impeachment events.

公开(公告)号：US20180329936A1

公开(公告)日：2018-11-15

申请号：US16042884

申请日：2018-07-23

Applicant: Amazon Technologies, Inc.

Inventor： Timothy Daniel Cole ,  John Michael Morkel ,  Tate Andrew Certain ,  Christopher Richard Jacques de Kadt ,  Artem Danilov ,  Andrew Wayne Ross ,  Allan Henry Vermeulen

IPC: G06F17/30

CPC classification number: G06F17/30351 ,  G06F17/30374 ,  G06F17/30383 ,  G06F17/30584 ,  G06F17/30595

Abstract: A materialization configuration request is received via a programmatic interface from a client of a journal-based multi-data-store database. The request indicates a partitioning rule to be used to select, for respective writes indicated in committed transaction entries of a journal, the materialization node at which the writes are to be stored. A control plane component of the database verifies that a set of materialization nodes corresponding to the partitioning rule has been established, and initiates the propagation of writes from the journal to the materialization nodes by respective write appliers.

公开(公告)号：US11960464B2

公开(公告)日：2024-04-16

申请号：US16042884

申请日：2018-07-23

Applicant: Amazon Technologies, Inc.

Inventor： Timothy Daniel Cole ,  John Michael Morkel ,  Tate Andrew Certain ,  Christopher Richard Jacques de Kadt ,  Artem Danilov ,  Andrew Wayne Ross ,  Allan Henry Vermeulen

IPC: G06F16/23 ,  G06F16/27 ,  G06F16/28

CPC classification number: G06F16/2315 ,  G06F16/2372 ,  G06F16/2393 ,  G06F16/27 ,  G06F16/278 ,  G06F16/284

Abstract: A materialization configuration request is received via a programmatic interface from a client of a journal-based multi-data-store database. The request indicates a partitioning rule to be used to select, for respective writes indicated in committed transaction entries of a journal, the materialization node at which the writes are to be stored. A control plane component of the database verifies that a set of materialization nodes corresponding to the partitioning rule has been established, and initiates the propagation of writes from the journal to the materialization nodes by respective write appliers.

公开(公告)号：US11243939B1

公开(公告)日：2022-02-08

申请号：US15201118

申请日：2016-07-01

Applicant: Amazon Technologies, Inc.

Inventor： Yevgeniy Mikhaylyuta ,  Timothy Daniel Cole ,  John Michael Morkel ,  Christopher Richard Jacques de Kadt ,  Allan Henry Vermeulen

IPC: G06F16/23 ,  G06F16/28 ,  G06F16/22

Abstract: A journaled database system may comprise data nodes that collectively maintain a collection of data and provide clients with read and write access to the collection. Correlated classification functions may be associated with read and write operations, such that items affected by a write operation are classified similarly to items accessed during a read operation. Read and write signatures may be formed based on the classification. Conflicts may be detected by comparing the read and write signatures for equivalent or overlapping classifications.

公开(公告)号：US10296606B2

公开(公告)日：2019-05-21

申请号：US15376410

申请日：2016-12-12

Applicant: Amazon Technologies, Inc.

Inventor： Allan Henry Vermeulen ,  Timothy Andrew Rath ,  Timothy Daniel Cole ,  Kiran-Kumar Muniswamy-Reddy

IPC: G06F17/30

Abstract: At a client-side component of a storage group, a read descriptor generated in response to a read request directed to a first data store is received. The read descriptor includes a state transition indicator corresponding to a write that has been applied at the first data store. A write descriptor indicative of a write that depends on a result of the read request is generated at the client-side component. The read descriptor and the write descriptor are included in a commit request for a candidate transaction at the client-side component, and transmitted to a transaction manager.

公开(公告)号：US20190121792A1

公开(公告)日：2019-04-25

申请号：US16221212

申请日：2018-12-14

Applicant: Amazon Technologies, Inc.

Inventor： Timothy Daniel Cole ,  John Michael Morkel ,  Yevgeniy Mikhaylyuta ,  Allan Henry Vermeulen ,  Christopher Richard Jacques de Kadt

IPC: G06F16/21 ,  G06F16/18

Abstract: A journaled database system may comprise data nodes that maintain a collection of data structured in accordance with a schema. A change to the schema may be applied by a journal module while a journal consumer continues to operate using a prior version of the schema. A buffer may be formed and have stored therein records describing state change instructions according to the prior view of the schema. An index of correspondence between the records in the buffer and in the source journal may be maintained.

公开(公告)号：US10235407B1

公开(公告)日：2019-03-19

申请号：US14833008

申请日：2015-08-21

Applicant: Amazon Technologies, Inc.

Inventor： John Michael Morkel ,  Timothy Daniel Cole ,  Andrew Wayne Ross ,  Artem Danilov ,  Allan Henry Vermeulen ,  Tate Andrew Certain ,  Christopher Richard Jacques De Kadt

IPC: G06F17/30

Abstract: A forking coordinator of a journal-based multi-data-store database determines that a forking criterion for a first journal has been met. The coordinator stores an indication that processing of transaction requests directed to a particular subset of the database is suspended. The coordinator instantiates a second journal for storing committed transaction entries for the particular subset. Metadata of the second journal indicates that transaction entries with sequence numbers in a particular range are stored in the first journal. The coordinator stores an indication that transaction processing associated with the particular subset of the system is to be resumed using the second journal.

公开(公告)号：US10133767B1

公开(公告)日：2018-11-20

申请号：US14868271

申请日：2015-09-28

Applicant: Amazon Technologies, Inc.

Inventor： Timothy Daniel Cole ,  Artem Danilov ,  Andrew Wayne Ross ,  John Michael Morkel ,  Tate Andrew Certain ,  Allan Henry Vermeulen ,  Christopher Richard Jacques De Kadt

IPC: G06F17/30

Abstract: A journal manager of a multi-data-store storage appends a committed transaction entry to a journal, indicating a state change which has been approved for commit using an optimistic concurrency control algorithm. A first representation of the state change is generated and stored at one materialization node. A different representation of the same state change, comprising at least one attribute for which a value is not included in the first representation, is generated and stored at a different materialization node.

公开(公告)号：US11803561B1

公开(公告)日：2023-10-31

申请号：US14231597

申请日：2014-03-31

Applicant: Amazon Technologies, Inc.

Inventor： William Nathan John Hurst ,  Timothy Daniel Cole

IPC: G06F16/2458 ,  G06F16/31

CPC classification number: G06F16/2462 ,  G06F16/313

Abstract: Documents may be maintained in a repository and retrieved based on searches that specify labels as criteria. Documents may be associated with groups of labels identified as topics. Searches may be performed using binary-encoded matrices specifying relationships between documents and topics, topics and labels and differential information indicating differences between topics and labels associated with documents. An initial result estimate may be based on forming a product of a documents-topics matrix and a topics-labels matrix. The initial estimate may be corrected by applying the differential information.