-
公开(公告)号:US10509601B2
公开(公告)日:2019-12-17
申请号:US15392878
申请日:2016-12-28
Applicant: Amazon Technologies, Inc.
Inventor: Norbert P. Kusters , Nachiappan Arumugam , Christopher Nathan Watson , Marc John Brooker , David R. Richardson , Danny Wei , John Luther Guthrie, II
Abstract: A data storage system includes multiple data storage units and a zonal control plane. The zonal control plane assigns volumes to respective ones of the data storage units. The data storage units include multiple head nodes and data storage sleds. At least one of the head nodes implements a local control plane for the data storage unit. Also, the head nodes of each data storage unit are configured to service read and write requests directed to one or more volumes serviced by the data storage unit independent of the zonal control plane.
-
公开(公告)号:US20190158419A1
公开(公告)日:2019-05-23
申请号:US16166929
申请日:2018-10-22
Applicant: Amazon Technologies, Inc.
Inventor: Tate Andrew Certain , Roland Paterson-Jones , James R. Hamilton , Sachin Jain , Matthew S. Garman , David N. Sunderland , Danny Wei , Fiorenzo Cattaneo
IPC: H04L12/911 , H04L29/08 , G06Q10/00 , G06Q30/02 , G06Q30/04
Abstract: Commitments against various resources can be dynamically adjusted for customers in a shared-resource environment. A customer can provision a data volume with a committed rate of Input/Output Operations Per Second (IOPS) and pay only for that commitment (plus any overage), for example, as well as the amount of storage requested. The customer can subsequently adjust the committed rate of IOPS by submitting an appropriate request, or the rate can be adjusted automatically based on any of a number of criteria. Data volumes for the customer can be migrated, split, or combined in order to provide the adjusted rate. The interaction of the customer with the data volume does not need to change, independent of adjustments in rate or changes in the data volume, other than the rate at which requests are processed.
-
公开(公告)号:US10204017B2
公开(公告)日:2019-02-12
申请号:US14705892
申请日:2015-05-06
Applicant: Amazon Technologies, Inc.
Inventor: Marc J. Brooker , Tobias L. Holgers , Madhuvanesh Parthasarathy , Danny Wei
Abstract: The relative health of data storage drives may be determined based, at least in some aspects, on data access information and/or other drive operation information. In some examples, upon receiving the operation information from a computing device, a health level of a drive may be determined. The health level determination may be based at least in part on operating information received from a client entity. Additionally, a storage space allocation instruction or operation may be determined for execution. The allocation instruction or operation determined to be performed may be based at least in part on the determined health level.
-
公开(公告)号:US10191813B2
公开(公告)日:2019-01-29
申请号:US15694684
申请日:2017-09-01
Applicant: Amazon Technologies, Inc.
Inventor: Jianhua Fan , Benjamin Arthur Hawks , Norbert Paul Kusters , Nachiappan Arumugam , Danny Wei , John Luther Guthrie, II
Abstract: Persistent storage for a master copy is provided using operation numbers. A master copy can include a persistent key-value store such as a B-tree with references to corresponding data. When provisioning a slave copy, the master copy sends a point-in-time copy of the B-tree to the slave copy, which stores a copy of the B-tree, allocates the necessary space, and updates the references of the B-tree to point to a local storage before the data is transferred. When writing the data to persistent storage, a snapshot created on the master copy is an operation that is replicated to the slave copy. The snapshot is generated using a volume view that includes changes to chunks of data of the master copy since a previous snapshot, as determined using the operation number for the previous snapshot. Data (and metadata) for the snapshot is written to persistent storage while new input/output operations are processed.
-
公开(公告)号:US20180232165A1
公开(公告)日:2018-08-16
申请号:US15433956
申请日:2017-02-15
Applicant: Amazon Technologies, Inc.
Inventor: Norbert Paul Kusters , Nachiappan Arumugam , Andre Podnozov , Shobha Agrawal , Shreyas Ramalingam , Danny Wei , David R. Richardson , Marc John Brooker , Christopher Nathan Watson , John Luther Guthrie, II , Ravi Nankani
CPC classification number: G06F3/0619 , G06F3/065 , G06F3/0683 , G06F11/2058 , G06F11/2064 , G06F11/2071 , G06F2201/84
Abstract: A data storage system includes a head node and mass storage devices. The head node is configured to flush data stored in a storage of the head node to a set of the mass storage devices of the data storage system. A head node may flush both current version data and point-in-time version data to the set of mass storage devices. Also, the data storage system maintains an index that indicates storage locations of data for particular portions of a volume before and after the data is flushed to the set of mass storage devices. In some embodiments an index includes a current version reference for a volume or portion of a volume and one or more point-in-time snapshot references.
-
公开(公告)号:US09893972B1
公开(公告)日:2018-02-13
申请号:US14571223
申请日:2014-12-15
Applicant: Amazon Technologies, Inc.
Inventor: Marc Stephen Olson , Jeevan Shankar , James Michael Thompson , Danny Wei , John Robert Smiley , John Luther Guthrie, II , Nachiappan Arumugam , Benjamin Arthur Hawks
CPC classification number: H04L43/0876 , H04L67/10
Abstract: Systems and methods are described providing detailed input/output (I/O) metric information that is collected and gathered by an agent of the storage volume. An I/O request is received by a storage volume, and the agent associates primary and secondary identifiers with that I/O request. For example, a trace may be associated with that I/O request. The agent may store this I/O metric information in a ring buffer. Further, after collection and aggregation, statistics may be published by an I/O metric service that further processes the data provided by the agent. Advantageously, interdependent relationships associated with the I/O request or I/O operations of that request may be included in those statistics. This may allow an operator to evaluate the performance of I/O requests for a network.
-
公开(公告)号:US09754337B2
公开(公告)日:2017-09-05
申请号:US14243752
申请日:2014-04-02
Applicant: Amazon Technologies, Inc.
Inventor: Marc J. Brooker , Madhuvanesh Parthasarathy , Danny Wei , Tobias L. Holgers , Yu Li
CPC classification number: G06Q50/22 , G06F11/00 , G06F11/008 , G06F11/0727 , G06F11/0793 , G06F19/00 , G06Q10/10
Abstract: The relative health of data storage drives may be determined based, at least in some aspects, on data access information and/or other drive operation information. In some examples, upon receiving the operation information from a computing device, a health level of a drive may be determined. The health level determination may be based at least in part on operating information received from a client entity. Additionally, a storage space allocation instruction or operation may be determined for execution. The allocation instruction or operation determined to be performed may be based at least in part on the determined health level.
-
公开(公告)号:US09733869B1
公开(公告)日:2017-08-15
申请号:US14866652
申请日:2015-09-25
Applicant: Amazon Technologies, Inc.
Inventor: Jianhua Fan , Benjamin Arthur Hawks , Norbert Paul Kusters , Nachiappan Arumugam , Danny Wei , John Luther Guthrie, II
IPC: G06F3/06
CPC classification number: G06F3/0665 , G06F3/0619 , G06F3/065 , G06F3/067 , G06F11/1435
Abstract: A slave storage is provisioned using metadata of a master B-tree and updates to references (e.g., offsets) pertaining to data operations of the master B-tree. Master-slave pairs can be used to provide data redundancy, and a master copy can include the master B-tree with references to corresponding data. When provisioning a slave copy, the master sends a B-tree copy to the slave, which stores the slave B-tree copy, allocates the necessary space on local storage, and updates respective offsets of the slave B-tree copy to point to the local storage. Data from the master can then be transferred to the slave and stored according to a note and commit process that ensures operational sequence of the data. Operations received to the master during the process can be committed to the slave copy until the slave is consistent with the master and able to take over as master in the event of a failure.
-
公开(公告)号:US20130346480A1
公开(公告)日:2013-12-26
申请号:US13860305
申请日:2013-04-10
Applicant: Amazon Technologies, Inc.
Inventor: Tate Andrew Certain , Sachin Jain , James R. Hamilton , Fiorenzo Cattaneo , Danny Wei , David Nolan Sunderland
IPC: G06F15/167
CPC classification number: G06F15/167 , G06F9/52 , G06F17/30171 , H04L67/1097
Abstract: Techniques, including systems and methods, for capturing data sets include performing a client-side two-phase commit to ensure one or more data consistency conditions. A logical volume may represent a data set that is distributed among a plurality of physical storage devices. One or more client devices are instructed to block at least acknowledgment of write operations. When the one or more client devices have blocked at least acknowledgment of write operations, one or more servers in communication with the physical storage devices are instructed to capture corresponding portions of the data set. When the servers have been instructed to capture corresponding portions of the data set, the client devices are instructed to resume at least acknowledgment of write operations.
Abstract translation: 用于捕获数据集的技术(包括系统和方法)包括执行客户端两阶段提交以确保一个或多个数据一致性条件。 逻辑卷可以表示分布在多个物理存储设备之间的数据集。 指示一个或多个客户端设备至少阻止写入操作的确认。 当一个或多个客户端设备至少阻止写操作的确认时,指示与物理存储设备通信的一个或多个服务器捕获数据集的相应部分。 当指示服务器捕获数据集的相应部分时,指示客户端设备至少恢复写入操作的确认。
-
公开(公告)号:US12111739B1
公开(公告)日:2024-10-08
申请号:US17937361
申请日:2022-09-30
Applicant: Amazon Technologies, Inc.
Inventor: Ravi Mantrala , Peng Wu , Danny Wei , Shailesh Bhagwat , Sandeep Kumar
CPC classification number: G06F11/2025 , G06F9/5044 , G06F9/5077 , G06F11/0772
Abstract: Systems and methods are described for use of reserved storage capacity at a cloud provider network extension, sometimes referred to as a provider substrate extension (“PSE”) or “outpost”, as a data cache, thereby improving performance of the PSE. The reserved storage capacity may be reserved for a primary purpose, such as data replication in the event of failure of an in-use portion of the PSE's storage capacity. During non-failover operation, the reserved storage capacity may be otherwise unused. Embodiments of the present disclosure enable the reserved storage capacity, when not used for its primary purpose, to be used as a data cache to store information potentially used at the PSE.
-
-
-
-
-
-
-
-
-