公开(公告)号：US20210089662A1

公开(公告)日：2021-03-25

申请号：US16579680

申请日：2019-09-23

Applicant: Amazon Technologies, Inc.

Inventor： Kiran-Kumar Muniswamy-Reddy ,  Romain Benoit Seguy ,  Rahul Upadhyaya ,  Divya Ashok Kumar Jain ,  William Zaharchuk ,  Wells Lin

IPC: G06F21/60 ,  H04L29/06 ,  G06F9/455 ,  H04L9/08 ,  G06F9/54 ,  G06F3/06

Abstract: The present disclosure generally relates to creating virtualized block storage devices whose data is replicated across isolated computing systems to lower risk of data loss even in wide-scale events, such as natural disasters. The virtualized device can include at least two volumes, each of which is implemented in a distinct computing system. Each volume can be encrypted with a distinct key, and an encryption service can operate to transform data “in-flight” on the replication path between the volumes, reencrypting data according to the key appropriate for each volume.

公开(公告)号：US20190332269A1

公开(公告)日：2019-10-31

申请号：US15967284

申请日：2018-04-30

Applicant: Amazon Technologies, Inc.

Inventor： Christopher Magee Greenwood ,  Danny Wei ,  Kiran-Kumar Muniswamy-Reddy ,  Wells Lin ,  Igor A. Kostic ,  Colin Williams

IPC: G06F3/06

Abstract: Generally described, aspects of the present application correspond to enabling rapid duplication of data within a data volume hosted on a network storage system. The network storage system can maintain a highly distributed replica of the data volume, designated for duplication of data within the volume and separate from one or more other replicas designated for handling modifications to the data volume. By providing increased parallelization, the highly distributed replica can facilitate rapid duplication of the volume. When a sufficiently large request to duplicate the data volume is received, the system can create additional duplicate portions of the volume to further increase parallelization. For example, a partition of the highly distributed replica may be repeatedly duplicated to create a large number of intermediary duplicate partitions. The intermediary duplicate partitions can then be used to service the duplication request rapidly, due to increased parallelism.

公开(公告)号：US10296606B2

公开(公告)日：2019-05-21

申请号：US15376410

申请日：2016-12-12

Applicant: Amazon Technologies, Inc.

Inventor： Allan Henry Vermeulen ,  Timothy Andrew Rath ,  Timothy Daniel Cole ,  Kiran-Kumar Muniswamy-Reddy

IPC: G06F17/30

Abstract: At a client-side component of a storage group, a read descriptor generated in response to a read request directed to a first data store is received. The read descriptor includes a state transition indicator corresponding to a write that has been applied at the first data store. A write descriptor indicative of a write that depends on a result of the read request is generated at the client-side component. The read descriptor and the write descriptor are included in a commit request for a candidate transaction at the client-side component, and transmitted to a transaction manager.

公开(公告)号：US10158709B1

公开(公告)日：2018-12-18

申请号：US14745278

申请日：2015-06-19

Applicant: Amazon Technologies, Inc.

Inventor： Kiran-Kumar Muniswamy-Reddy ,  Wei Xiao

IPC: G06F9/54 ,  H04L29/08 ,  G06F17/30

Abstract: A data storage system that implements identifying data store requests for asynchronous processing. A request may be received at a frontend task engine that processes requests for a network-based data store. The frontend task engine may evaluate the request to determine whether the request should be processed asynchronously. For a request identified for asynchronous processing, the task engine may initiate processing of the request at backend task engines for the network-based data store. Resources for processing the request at the frontend task engine may be reclaimed for processing other requests. A task sweeper that collects data for the network-based data store may detect that processing of the request has completed. The task sweeper may also provide an indication of the completion of the request.

公开(公告)号：US09996573B1

公开(公告)日：2018-06-12

申请号：US14222377

申请日：2014-03-21

Applicant: Amazon Technologies, Inc.

Inventor： Akshat Vig ,  Wei Xiao ,  Somasundaram Perianayagam ,  Timothy Andrew Rath ,  Barry Bailey Hunter, Jr. ,  Kiran-Kumar Muniswamy-Reddy ,  Yijun Lu ,  Qiang Liu ,  Ying Lin ,  Stuart Henry Seelye Marshall

IPC: G06F17/30

CPC classification number: G06F17/30584

Abstract: A hosted service may limit access to a table initially comprising one or more partitions. Access to the table may be limited to a provisioned capacity. A client of the service may request an increased capacity. A minimum number of partitions for providing the increased capacity may be determined. Proportions of the increased capacity may be allocated among members of successive generations of partitions to be provided by a member of a generation or its descendants. The proportions may be allocated to minimize the costs associated with splitting partitions based on the minimum number of partitions.

公开(公告)号：US09330158B1

公开(公告)日：2016-05-03

申请号：US13898201

申请日：2013-05-20

Applicant: Amazon Technologies, Inc.

Inventor： Wei Xiao ,  Miguel Mascarenhas Filipe ,  Bjorn Patrick Swift ,  Kiran-Kumar Muniswamy-Reddy ,  Stuart Henry Seelye Marshall ,  Timothy Andrew Rath ,  Rande A. Blackman

IPC: G06F7/00 ,  G06F17/30

CPC classification number: G06F17/30584 ,  H04L67/1008 ,  H04L67/1095 ,  H04L67/1097

Abstract: Distributed database management systems may perform range queries over the leading portion of a primary key. Non-random distribution of data may improve performance related to the processing of range queries, but may tend to cause workload to be concentrated on particular partitions. Groups of partitions may be expanded and collapsed based on detection of disproportionate workload. Disproportionate write workload may be distributed among a group of partitions that can subsequently be queried using a federated approach. Disproportionate read workload may be distributed among a group of read-only replicated partitions.

Abstract translation: 分布式数据库管理系统可以在主键的前导部分上执行范围查询。 数据的非随机分布可以提高与范围查询的处理相关的性能，但可能倾向于使工作负载集中在特定分区上。 基于检测不成比例的工作负载，可能会将分区组扩展和折叠。 不成比例的写入工作负载可能会分布在一组分区中，随后可以使用联合方法进行查询。 不成比例的读取工作负载可能会分布在一组只读复制分区中。

公开(公告)号：US09274902B1

公开(公告)日：2016-03-01

申请号：US13961720

申请日：2013-08-07

Applicant: Amazon Technologies, Inc.

Inventor： Adam Douglas Morley ,  Barry Bailey Hunter, Jr. ,  Yijun Lu ,  Timothy Andrew Rath ,  Kiran-Kumar Muniswamy-Reddy ,  Xianglong Huang ,  Jiandan Zheng

IPC: G06F11/00 ,  G06F11/20 ,  G06F11/07

CPC classification number: G06F11/2002 ,  G06F11/0709 ,  G06F11/0787 ,  G06F11/079 ,  G06F11/0793 ,  G06F11/2094

Abstract: An automated system may be employed to perform detection, analysis and recovery from faults occurring in a distributed computing system. Faults may be recorded in a metadata store for verification and analysis by an automated fault management process. Diagnostic procedures may confirm detected faults. The automated fault management process may perform recovery workflows involving operations such as rebooting faulting devices and excommunicating unrecoverable computing nodes from affected clusters.

Abstract translation: 可以采用自动化系统来执行从发生在分布式计算系统中的故障的检测，分析和恢复。 可以将故障记录在元数据存储中，以通过自动化故障管理过程进行验证和分析。 诊断程序可以确认检测到的故障。 自动化故障管理过程可以执行涉及诸如重新启动故障设备和从受影响的集群中传播不可恢复的计算节点的操作的恢复工作流。

公开(公告)号：US09262505B2

公开(公告)日：2016-02-16

申请号：US13897232

申请日：2013-05-17

Applicant: Amazon Technologies, Inc.

Inventor： David Craig Yanacek ,  Bjorn Patrick Swift ,  Wei Xiao ,  Kiran-Kumar Muniswamy-Reddy ,  Miguel Mascarenhas Filipe ,  Yijun Lu

IPC: G06F17/30

CPC classification number: G06F17/30595 ,  G06F17/30289 ,  G06F17/30386

Abstract: A database management system may be operated by a third-party provider that hosts the system in a datacenter and provides access to the system to end users on behalf of various entities. Limits on total capacity consumption may be imposed, but may result in service outages when capacity consumption exceeds those limits. Requests to perform operations on the system may be classified. The request classifications may be associated with policies for admitting or rejecting the request. One or more token buckets representative of capacity available to the request to perform the operation may be used to determine to admit the request and updated based on the cost of performing the operation.

Abstract translation: 数据库管理系统可以由在数据中心中承载系统的第三方提供商来操作，并且代表各种实体向终端用户提供对系统的访问。 总容量消耗的限制可能会受到限制，但是当容量消耗超过这些限制时可能导致服务中断。 可以对在系统上执行操作的请求进行分类。 请求分类可能与允许或拒绝请求的策略相关联。 可以使用表示可用于执行操作的请求的容量的一个或多个令牌桶来确定承认请求并且基于执行操作的成本来更新。