-
公开(公告)号:US11461156B2
公开(公告)日:2022-10-04
申请号:US17239440
申请日:2021-04-23
Applicant: Amazon Technologies, Inc.
Inventor: Fan Ping , Andrew Boyer , Oleksandr Chychykalo , James Pinkerton , Danny Wei , Norbert Paul Kusters , Divya Ashok Kumar Jain , Jianhua Fan , Thomas Tarak Mathew Veppumthara , Sebastiano Peluso
Abstract: A block-based storage system hosts logical volumes that are implemented via multiple replicas of volume data stored on multiple resource hosts in different failure domains. Also, the block-based storage service allows multiple client computing devices to attach to a same given logical volume at the same time. In order to prevent unnecessary failovers, a primary node storing a primary replica is configured with a health check application programmatic interface (API) and a secondary node storing a secondary replica determines whether or not to initiate a failover based on the health of the primary replica.
-
公开(公告)号:US20210240560A1
公开(公告)日:2021-08-05
申请号:US17239440
申请日:2021-04-23
Applicant: Amazon Technologies, Inc.
Inventor: Fan Ping , Andrew Boyer , Oleksandr Chychykalo , James Pinkerton , Danny Wei , Norbert Paul Kusters , Divya Ashok Kumar Jain , Jianhua Fan , Thomas Tarak Mathew Veppumthara , Sebastiano Peluso
Abstract: A block-based storage system hosts logical volumes that are implemented via multiple replicas of volume data stored on multiple resource hosts in different failure domains. Also, the block-based storage service allows multiple client computing devices to attach to a same given logical volume at the same time. In order to prevent unnecessary failovers, a primary node storing a primary replica is configured with a health check application programmatic interface (API) and a secondary node storing a secondary replica determines whether or not to initiate a failover based on the health of the primary replica.
-
公开(公告)号:US10990464B1
公开(公告)日:2021-04-27
申请号:US16560859
申请日:2019-09-04
Applicant: Amazon Technologies, Inc.
Inventor: Fan Ping , Andrew Boyer , Oleksandr Chychykalo , James Pinkerton , Danny Wei , Norbert Paul Kusters , Divya Ashok Kumar Jain , Jianhua Fan , Thomas Tarak Mathew Veppumthara , Sebastiano Peluso
Abstract: A block-based storage system hosts logical volumes that are implemented via multiple replicas of volume data stored on multiple resource hosts in different failure domains. Also, the block-based storage service allows multiple client computing devices to attach to a same given logical volume at the same time. In order to prevent unnecessary failovers, a primary node storing a primary replica is configured with a health check application programmatic interface (API) and a secondary node storing a secondary replica determines whether or not to initiate a failover based on the health of the primary replica.
-
公开(公告)号:US10896061B2
公开(公告)日:2021-01-19
申请号:US16460914
申请日:2019-07-02
Applicant: Amazon Technologies, Inc.
Inventor: Norbert Paul Kusters , John Robert Smiley , Marc John Brooker , Bei-Jing Guo , Marc Levy
Abstract: Burst throttling methods may be used to manage computing resources of a data storage service. Tokens may represent I/O operations executed by a customer of the data storage service. A first token bucket may contain a set of tokens representing the overall I/O operation capacity of the data storage service. Additionally, a second token bucket may contain a set of tokens for a given logical volume maintained by the data storage service. When I/O requests are received tokens may be charged the first token bucket and the second token bucket. Furthermore, if there is sufficient capacity, the data storage service may charge a reduced number of tokens to the third token bucket.
-
公开(公告)号:US10404613B1
公开(公告)日:2019-09-03
申请号:US14230539
申请日:2014-03-31
Applicant: Amazon Technologies, Inc.
Inventor: Marc John Brooker , Marc Levy , Norbert Paul Kusters , David R. Richardson , Marc Stephen Olson
IPC: G06F12/16 , G06F12/00 , G06F17/30 , G06F7/00 , G06F15/173 , G06F21/00 , H04L12/911
Abstract: Computing resource services have computing resources allocated among regions and data zones, where regions can be completely separate deployments of an infrastructure to provide the highest degree of independence. The more regions that are utilized by a customer, the higher the level of fault tolerance may exist. Current networks consist of heavily distributed infrastructures or mainly centralized infrastructures, both of which can cause complete control plane failures when even a subset of a data zone or region loses network connectivity. The placement of control plane and data plane resources provides for optimal availability and durability during infrastructure failures.
-
公开(公告)号:US20190155694A1
公开(公告)日:2019-05-23
申请号:US16259571
申请日:2019-01-28
Applicant: Amazon Technologies, Inc.
Inventor: Jianhua Fan , Benjamin Arthur Hawks , Norbert Paul Kusters , Nachiappan Arumugam , Danny Wei , John Luther Guthrie
CPC classification number: G06F11/1448 , G06F3/0605 , G06F3/0619 , G06F3/065 , G06F3/067 , G06F3/0689 , G06F11/1446 , G06F11/1464 , G06F11/1471 , G06F2201/84
Abstract: The present disclosure provides persistent storage for a master copy using operation numbers. A master copy can include a B-tree with references to corresponding data. When provisioning a slave copy, the master copy sends a point-in-time copy of the B-tree to the slave copy, which stores a copy of the B-tree, allocates the necessary space, and updates the references of the B-tree to point to a local storage before the data is transferred. When writing the data to persistent storage, a snapshot created on the master copy is an operation that is replicated to the slave copy. The snapshot is generated using a volume view that includes changes to chunks of data of the master copy since a previous snapshot, as determined using the operation number for the previous snapshot. Data (and metadata) for the snapshot is written to persistent storage while new I/O operations are processed.
-
公开(公告)号:US20170351462A1
公开(公告)日:2017-12-07
申请号:US15673271
申请日:2017-08-09
Applicant: Amazon Technologies, Inc.
Inventor: Jianhua Fan , Benjamin Arthur Hawks , Norbert Paul Kusters , Nachiappan Arumugam , Danny Wei , John Luther Guthrie, II
IPC: G06F3/06
CPC classification number: G06F3/0665 , G06F3/0619 , G06F3/065 , G06F3/067 , G06F11/1435
Abstract: A slave storage is provisioned using metadata of a master B-tree and updates to references (e.g., offsets) pertaining to data operations of the master B-tree. Master-slave pairs can be used to provide data redundancy, and a master copy can include the master B-tree with references to corresponding data. When provisioning a slave copy, the master sends a B-tree copy to the slave, which stores the slave B-tree copy, allocates the necessary space on local storage, and updates respective offsets of the slave B-tree copy to point to the local storage. Data from the master can then be transferred to the slave and stored according to a note and commit process that ensures operational sequence of the data. Operations received to the master during the process can be committed to the slave copy until the slave is consistent with the master and able to take over as master in the event of a failure.
-
公开(公告)号:US11625180B1
公开(公告)日:2023-04-11
申请号:US17118300
申请日:2020-12-10
Applicant: Amazon Technologies, Inc.
Inventor: Swapnil Vinay Dinkar , Pradeep Kunni Raman , David Matthew Buches , Hon Ping Shea , Norbert Paul Kusters
IPC: G06F3/06
Abstract: A storage service supports attachment of multiple clients to a distributed storage object and further supports persistent reservations that govern types of access the respective clients are granted with respect to the distributed storage object. In order to efficiently distribute reservation state changes to multiple partitions of the distributed storage object hosted by different data storage units/servers, existing connections are used between the data storage units/servers hosting the partitions of the distributed storage object and the connected clients to propagate reservation state changes.
-
公开(公告)号:US11301144B2
公开(公告)日:2022-04-12
申请号:US16457095
申请日:2019-06-28
Applicant: Amazon Technologies, Inc.
Inventor: Norbert Paul Kusters , Jianhua Fan , Shuvabrata Ganguly , Danny Wei , Avram Israel Blaszka
IPC: G06F3/06
Abstract: A data storage system includes multiple head nodes and data storage sleds. A control plane of the data storage system designates, for a volume partition, one of the head nodes to function as a primary head node storing a primary replica of the volume partition and designates two or more other head nodes to function as reserve head nodes storing reserve replicas of the volume partition. Additionally, the primary head node causes volume data for the volume partition to be erasure encoded and stored on multiple mass storage devices in different ones of the data storage sleds.
-
公开(公告)号:US11237751B2
公开(公告)日:2022-02-01
申请号:US16579687
申请日:2019-09-23
Applicant: Amazon Technologies, Inc.
Inventor: Kiran-Kumar Muniswamy-Reddy , Danny Wei , Norbert Paul Kusters , Romain Benoit Seguy , Rahul Upadhyaya , Divya Ashok Kumar Jain , William Zaharchuk , Wells Lin
Abstract: The present disclosure generally relates to creating virtualized block storage devices whose data is replicated across isolated computing systems to lower risk of data loss even in wide-scale events, such as natural disasters. The virtualized device can include at least two volumes, each of which is implemented in a distinct computing system. In the case of a failed volume, a new volume can be created and populated with data from the surviving volume. During population, new writes can continue to be replicated to the new volume. The population process can write data from the surviving volume to the new volume “under” new writes, such that the population process does not overwrite data included in the new writes.
-
-
-
-
-
-
-
-
-