公开(公告)号：US10754854B2

公开(公告)日：2020-08-25

申请号：US15925666

申请日：2018-03-19

Applicant: Amazon Technologies, Inc.

Inventor： Xianglong Huang ,  David Alan Lutz ,  Wei Xiao ,  Maximiliano Maccanti ,  Somasundaram Perianayagam ,  Rande A. Blackman ,  Stuart Henry Seelye Marshall

IPC: G06F16/2453 ,  G06F16/22 ,  G06F16/23 ,  G06F16/27

Abstract: A distributed database management system may comprise a plurality of computing nodes. A request to update an item maintained by the system may be acknowledged as durable and committed once an entry corresponding to the request has been written to a log file and quorum among the computing nodes has been achieved. Improved consistency may be achieved by maintaining snapshots of committed item states within queryable in-memory snapshot data structures. Range queries may be performed by merging a secondary index with the snapshots and applying filters. Projections may be completed by retrieving additional data from an item collection maintain on one or more storage devices.

公开(公告)号：US09875270B1

公开(公告)日：2018-01-23

申请号：US14859053

申请日：2015-09-18

Applicant: Amazon Technologies, Inc.

Inventor： Kiran Kumar Muniswamy Reddy ,  Wei Xiao ,  Pejus Manoj Das ,  Xianglong Huang ,  Nirmal Mehta

IPC: G06F17/30

CPC classification number: G06F17/30362 ,  G06F17/30321 ,  G06F17/30345 ,  G06F17/30589

Abstract: A data storage system may implement locking item ranges for creating a secondary index of an online table. A secondary index may be generated for a table of items stored in a non-relational data store. Different ranges of items in the data store may be locked while a corresponding portion of the secondary index is generated. Upon generating the corresponding portion of the secondary index, a range of items may be unlocked. While generating the secondary index, the table may be made available for servicing access requests. For a request to update the table received during the generation of the secondary index, a determination may be made as to whether the update is included within a locked range of the table. If locked, the request may be delayed until the range is unlocked.

公开(公告)号：US10216768B1

公开(公告)日：2019-02-26

申请号：US14182258

申请日：2014-02-17

Applicant: AMAZON TECHNOLOGIES, INC.

Inventor： Xianglong Huang ,  Yijun Lu ,  Wei Xiao ,  Jiandan Zheng

IPC: G06F17/30

Abstract: One or more table partitions may communicate with an index partition that may be a master of a replication group. A communications channel may exist between table partitions and the index partition. Upon splitting the index partition, communications between the table partitions and the index partition may be suspended. Upon completion of the split, communications may be reestablished between the table partitions and a partition, of the replication group of index partitions, designated to be a master following the split. Messages accumulated by the table partitions during the split may be sent to the index partition upon reestablishing communications.

公开(公告)号：US20180210914A1

公开(公告)日：2018-07-26

申请号：US15925666

申请日：2018-03-19

Applicant: Amazon Technologies, Inc.

Inventor： Xianglong Huang ,  David Alan Lutz ,  Wei Xiao ,  Maimiliano Maccanti ,  Somasundaram Perianayagam ,  Rande A. Blackman ,  Stuart Henry Seelye Marshall

IPC: G06F17/30

CPC classification number: G06F16/24535 ,  G06F16/22 ,  G06F16/2365 ,  G06F16/2379 ,  G06F16/275

Abstract: A distributed database management system may comprise a plurality of computing nodes. A request to update an item maintained by the system may be acknowledged as durable and committed once an entry corresponding to the request has been written to a log file and quorum among the computing nodes has been achieved. Improved consistency may be achieved by maintaining snapshots of committed item states within queryable in-memory snapshot data structures. Range queries may be performed by merging a secondary index with the snapshots and applying filters. Projections may be completed by retrieving additional data from an item collection maintain on one or more storage devices.

公开(公告)号：US09922086B1

公开(公告)日：2018-03-20

申请号：US15400175

申请日：2017-01-06

Applicant: Amazon Technologies, Inc.

Inventor： Xianglong Huang ,  David Alan Lutz ,  Wei Xiao ,  Maximiliano Maccanti ,  Somasundaram Perianayagam ,  Rande A. Blackman ,  Stuart Henry Seelye Marshall

IPC: G06F17/30

CPC classification number: G06F17/30451 ,  G06F17/30312 ,  G06F17/30371 ,  G06F17/30377 ,  G06F17/30581

Abstract: A distributed database management system may comprise a plurality of computing nodes. A request to update an item maintained by the system may be acknowledged as durable and committed once an entry corresponding to the request has been written to a log file and quorum among the computing nodes has been achieved. Improved consistency may be achieved by maintaining snapshots of committed item states within queryable in-memory snapshot data structures. Range queries may be performed by merging a secondary index with the snapshots and applying filters. Projections may be completed by retrieving additional data from an item collection maintain on one or more storage devices.

公开(公告)号：US20190179807A1

公开(公告)日：2019-06-13

申请号：US16276413

申请日：2019-02-14

Applicant: Amazon Technologies, Inc.

Inventor： Xianglong Huang ,  Yijun Lu ,  Wei Xiao ,  Jiandan Zheng

IPC: G06F16/21

Abstract: One or more table partitions may communicate with an index partition that may be a master of a replication group. A communications channel may exist between table partitions and the index partition. Upon splitting the index partition, communications between the table partitions and the index partition may be suspended. Upon completion of the split, communications may be reestablished between the table partitions and a partition, of the replication group of index partitions, designated to be a master following the split. Messages accumulated by the table partitions during the split may be sent to the index partition upon reestablishing communications.

公开(公告)号：US10102228B1

公开(公告)日：2018-10-16

申请号：US14182248

申请日：2014-02-17

Applicant: Amazon Technologies, Inc.

Inventor： Xianglong Huang ,  Yijun Lu ,  Wei Xiao ,  Jiandan Zheng

IPC: G06F17/30

Abstract: One or more table partitions may communicate with one or more index partitions. A communications channel may be dedicated to each combination of table partition and index partition. The communications channel may act as a queue of messages corresponding to updates to data maintained in a table partition that have yet to be processed by a corresponding index partition. Upon splitting a table partition, communications channels may be duplicated including unprocessed messages. Connections between new table partitions and an index may be finalized upon the index's receipt of a message indicative of the new table partition.

公开(公告)号：US09274902B1

公开(公告)日：2016-03-01

申请号：US13961720

申请日：2013-08-07

Applicant: Amazon Technologies, Inc.

Inventor： Adam Douglas Morley ,  Barry Bailey Hunter, Jr. ,  Yijun Lu ,  Timothy Andrew Rath ,  Kiran-Kumar Muniswamy-Reddy ,  Xianglong Huang ,  Jiandan Zheng

IPC: G06F11/00 ,  G06F11/20 ,  G06F11/07

CPC classification number: G06F11/2002 ,  G06F11/0709 ,  G06F11/0787 ,  G06F11/079 ,  G06F11/0793 ,  G06F11/2094

Abstract: An automated system may be employed to perform detection, analysis and recovery from faults occurring in a distributed computing system. Faults may be recorded in a metadata store for verification and analysis by an automated fault management process. Diagnostic procedures may confirm detected faults. The automated fault management process may perform recovery workflows involving operations such as rebooting faulting devices and excommunicating unrecoverable computing nodes from affected clusters.

Abstract translation: 可以采用自动化系统来执行从发生在分布式计算系统中的故障的检测，分析和恢复。 可以将故障记录在元数据存储中，以通过自动化故障管理过程进行验证和分析。 诊断程序可以确认检测到的故障。 自动化故障管理过程可以执行涉及诸如重新启动故障设备和从受影响的集群中传播不可恢复的计算节点的操作的恢复工作流。

公开(公告)号：US11321283B2

公开(公告)日：2022-05-03

申请号：US16276413

申请日：2019-02-14

Applicant: Amazon Technologies, Inc.

Inventor： Xianglong Huang ,  Yijun Lu ,  Wei Xiao ,  Jiandan Zheng

IPC: G06F16/20 ,  G06F16/21 ,  G06F16/22 ,  G06F16/27

Abstract: One or more table partitions may communicate with an index partition that may be a master of a replication group. A communications channel may exist between table partitions and the index partition. Upon splitting the index partition, communications between the table partitions and the index partition may be suspended. Upon completion of the split, communications may be reestablished between the table partitions and a partition, of the replication group of index partitions, designated to be a master following the split. Messages accumulated by the table partitions during the split may be sent to the index partition upon reestablishing communications.

公开(公告)号：US10747739B1

公开(公告)日：2020-08-18

申请号：US14859055

申请日：2015-09-18

Applicant: Amazon Technologies, Inc.

Inventor： Kiran Kumar Muniswamy Reddy ,  Xianglong Huang ,  Pejus Manoj Das ,  Wei Xiao

IPC: G06F16/22 ,  G06F16/28 ,  G06F16/23

Abstract: A data storage system may implement implicit checkpoint for generating a secondary of a table. Indexing updates may be replicated and maintained across a replica group storing a table for a data store. Upon detection of a restart event for generating a secondary index, a replica in the replica group may evaluate the indexing updates to determine an index creation restart point according to an order for indexing the table. The generation of the secondary index may be resumed at the index creation restart point. In this way, secondary index generation may continue whether or not a previously indexing replica in the replica group, such as a master replica, is available to continue generating the secondary index.