公开(公告)号：US10157194B1

公开(公告)日：2018-12-18

申请号：US15199889

申请日：2016-06-30

Applicant: Amazon Technologies, Inc.

Inventor： Timothy Daniel Cole ,  John Michael Morkel ,  Yevgeniy Mikhaylyuta ,  Allan Henry Vermeulen ,  Christopher Richard Jacques de Kadt

IPC: G06F17/30

Abstract: A journaled database system may comprise data nodes that maintain a collection of data structured in accordance with a schema. A change to the schema may be applied by a journal module while a journal consumer continues to operate using a prior version of the schema. A buffer may be formed and have stored therein records describing state change instructions according to the prior view of the schema. An index of correspondence between the records in the buffer and in the source journal may be maintained.

公开(公告)号：US12050561B2

公开(公告)日：2024-07-30

申请号：US16221212

申请日：2018-12-14

Applicant: Amazon Technologies, Inc.

Inventor： Timothy Daniel Cole ,  John Michael Morkel ,  Yevgeniy Mikhaylyuta ,  Allan Henry Vermeulen ,  Christopher Richard Jacques de Kadt

IPC: G06F16/21 ,  G06F16/18 ,  G06F16/23

CPC classification number: G06F16/211 ,  G06F16/1815 ,  G06F16/213 ,  G06F16/219 ,  G06F16/2358

Abstract: A journaled database system may comprise data nodes that maintain a collection of data structured in accordance with a schema. A change to the schema may be applied by a journal module while a journal consumer continues to operate using a prior version of the schema. A buffer may be formed and have stored therein records describing state change instructions according to the prior view of the schema. An index of correspondence between the records in the buffer and in the source journal may be maintained.

公开(公告)号：US11243939B1

公开(公告)日：2022-02-08

申请号：US15201118

申请日：2016-07-01

Applicant: Amazon Technologies, Inc.

Inventor： Yevgeniy Mikhaylyuta ,  Timothy Daniel Cole ,  John Michael Morkel ,  Christopher Richard Jacques de Kadt ,  Allan Henry Vermeulen

IPC: G06F16/23 ,  G06F16/28 ,  G06F16/22

Abstract: A journaled database system may comprise data nodes that collectively maintain a collection of data and provide clients with read and write access to the collection. Correlated classification functions may be associated with read and write operations, such that items affected by a write operation are classified similarly to items accessed during a read operation. Read and write signatures may be formed based on the classification. Conflicts may be detected by comparing the read and write signatures for equivalent or overlapping classifications.

公开(公告)号：US20190121792A1

公开(公告)日：2019-04-25

申请号：US16221212

申请日：2018-12-14

Applicant: Amazon Technologies, Inc.

Inventor： Timothy Daniel Cole ,  John Michael Morkel ,  Yevgeniy Mikhaylyuta ,  Allan Henry Vermeulen ,  Christopher Richard Jacques de Kadt

IPC: G06F16/21 ,  G06F16/18

Abstract: A journaled database system may comprise data nodes that maintain a collection of data structured in accordance with a schema. A change to the schema may be applied by a journal module while a journal consumer continues to operate using a prior version of the schema. A buffer may be formed and have stored therein records describing state change instructions according to the prior view of the schema. An index of correspondence between the records in the buffer and in the source journal may be maintained.

公开(公告)号：US11886429B2

公开(公告)日：2024-01-30

申请号：US17104392

申请日：2020-11-25

Applicant: Amazon Technologies, Inc.

Inventor： George Steven McPherson ,  Yevgeniy Mikhaylyuta ,  Tobin Daniel Baker ,  Richard Jeffrey Cole

IPC: G06F21/62 ,  G06F16/24

CPC classification number: G06F16/24 ,  G06F21/6218

Abstract: A metadata catalog may store metadata about data sources. The metadata may define table, column, partition and/or data formats, as well as title information, textual descriptions, modification information, data schemas and access information, such as location and connection information. A metadata catalog service may provide a shared, persistent, central repository for the metadata. The metadata of the catalog may be published via multiple access mechanisms and programmatically obtained and processed by other programs via the metadata catalog service. Metadata consumers may utilize the metadata catalog service to perform various metadata tasks, such as metadata retrieval, creation, addition, modification and/or deletion. The metadata catalog service may be directly integrated into existing data analytic tools as a persistent and durable metadata store allowing users to utilize the broad set of data processing tools.

公开(公告)号：US11256669B1

公开(公告)日：2022-02-22

申请号：US15199796

申请日：2016-06-30

Applicant: Amazon Technologies, Inc.

Inventor： John Michael Morkel ,  Yevgeniy Mikhaylyuta ,  Timothy Daniel Cole ,  Christopher Richard Jacques de Kadt ,  Allan Henry Vermeulen

IPC: G06F16/21 ,  G06F16/23 ,  G06F16/22

Abstract: A journaled database system may comprise data nodes that maintain a collection of data and provide read access to the data to a client in accordance with a read schema and write access to the client in accordance with a write schema. A change to the schemas may be proposed. A materialization schema may be identified based on correlated determinations that both of the read schema and the write schema are satisfiable based on the materialization schema. The proposed changes may be accepted when the read schema and write schema are simultaneously satisfiable.

公开(公告)号：US20210173828A1

公开(公告)日：2021-06-10

申请号：US17104392

申请日：2020-11-25

Applicant: Amazon Technologies, Inc.

Inventor： George Steven McPherson ,  Yevgeniy Mikhaylyuta ,  Tobin Daniel Baker ,  Richard Jeffrey Cole

IPC: G06F16/24 ,  G06F21/62

Abstract: A metadata catalog may store metadata about data sources. The metadata may define table, column, partition and/or data formats, as well as title information, textual descriptions, modification information, data schemas and access information, such as location and connection information. A metadata catalog service may provide a shared, persistent, central repository for the metadata. The metadata of the catalog may be published via multiple access mechanisms and programmatically obtained and processed by other programs via the metadata catalog service. Metadata consumers may utilize the metadata catalog service to perform various metadata tasks, such as metadata retrieval, creation, addition, modification and/or deletion. The metadata catalog service may be directly integrated into existing data analytic tools as a persistent and durable metadata store allowing users to utilize the broad set of data processing tools.

公开(公告)号：US10853356B1

公开(公告)日：2020-12-01

申请号：US14310422

申请日：2014-06-20

Applicant: Amazon Technologies, Inc.

Inventor： George Steven McPherson ,  Yevgeniy Mikhaylyuta ,  Tobin Daniel Baker ,  Richard Jeffrey Cole

IPC: G06F16/24 ,  G06F21/62

Abstract: A metadata catalog may store metadata about data sources. The metadata may define table, column, partition and/or data formats, as well as title information, textual descriptions, modification information, data schemas and access information, such as location and connection information. A metadata catalog service may provide a shared, persistent, central repository for the metadata. The metadata of the catalog may be published via multiple access mechanisms and programmatically obtained and processed by other programs via the metadata catalog service. Metadata consumers may utilize the metadata catalog service to perform various metadata tasks, such as metadata retrieval, creation, addition, modification and/or deletion. The metadata catalog service may be directly integrated into existing data analytic tools as a persistent and durable metadata store allowing users to utilize the broad set of data processing tools.