公开(公告)号：US11444641B2

公开(公告)日：2022-09-13

申请号：US16684992

申请日：2019-11-15

Applicant: Amazon Technologies, Inc.

Inventor： Norbert P. Kusters ,  Nachiappan Arumugam ,  Christopher Nathan Watson ,  Marc John Brooker ,  David R. Richardson ,  Danny Wei ,  John Luther Guthrie, II ,  Leah Shalev

IPC: G06F3/06 ,  G06F11/10 ,  G06F11/20 ,  H03M13/15

Abstract: A data storage system includes multiple head nodes and data storage sleds. The data storage sleds include multiple mass storage devices and a sled controller. Respective ones of the head nodes are configured to obtain credentials for accessing particular portions of the mass storage devices of the data storage sleds. A sled controller of a data storage sled determines whether a head node attempting to perform a write on a mass storage device of a data storage sled that includes the sled controller is presenting with the write request a valid credential for accessing the mass storage devices of the data storage sled. If the credentials are valid, the sled controller causes the write to be performed and if the credentials are invalid, the sled controller returns a message to the head node indicating that it has been fenced off from the mass storage device.

公开(公告)号：US10802921B2

公开(公告)日：2020-10-13

申请号：US16259571

申请日：2019-01-28

Applicant: Amazon Technologies, Inc.

Inventor： Jianhua Fan ,  Benjamin Arthur Hawks ,  Norbert Paul Kusters ,  Nachiappan Arumugam ,  Danny Wei ,  John Luther Guthrie

IPC: G06F3/06 ,  G06F11/14

Abstract: Systems and methods for provisioning a slave copy for redundant data storage and for writing data to persistent storage in a block-based storage system using sequential operation numbers are provided. In one embodiment, the method includes maintaining a master copy and a slave copy of a data volume, the master copy including data generated by a plurality of operations having respective sequential operation numbers, receiving a write instruction for second data to be added to the master copy, and recording the second data as a note that is not readable. The method may further include sending a copy of the note from the master copy to the slave copy, committing the note to the master copy with a sequential operation number, and committing the copy of the note to the slave copy based in part on the sequential operation number. A B-tree may be created based at least in part on an offset for a write instruction associated with the second data, a length, and an operation number included in the note.

公开(公告)号：US20180232308A1

公开(公告)日：2018-08-16

申请号：US15433951

申请日：2017-02-15

Applicant: Amazon Technologies, Inc.

Inventor： Norbert Paul Kusters ,  Nachiappan Arumugam ,  Andre Podnozov ,  Shobha Agrawal ,  Shreyas Ramalingam ,  Danny Wei ,  David R. Richardson ,  Marc John Brooker ,  Christopher Nathan Watson ,  John Luther Guthrie, II ,  Ravi Nankani

IPC: G06F12/0808 ,  G06F3/06

CPC classification number: G06F3/0619 ,  G06F3/061 ,  G06F3/065 ,  G06F3/0665 ,  G06F3/0683 ,  G06F11/14 ,  G06F11/2007 ,  G06F11/2015 ,  G06F11/2058 ,  G06F2201/81 ,  G06F2201/84

Abstract: A data storage system includes a head node and mass storage devices. The head node is configured to flush data stored in a storage of the head node, based at least in part on one or more triggers being met, from the storage of the head node to a set of the mass storage devices of the data storage system. The flushed data is written to a segment of free storage space across the set of the mass storage devices allocated for the given data flush operation. In some embodiments, a head node may flush both current version data and point-in-time version data to the set of mass storage devices. Also, the data storage system maintains an index that indicates storage locations of data for particular portions of a volume before and after the data is flushed to the set of mass storage devices.

公开(公告)号：US10037298B2

公开(公告)日：2018-07-31

申请号：US15197573

申请日：2016-06-29

Applicant: Amazon Technologies, Inc.

Inventor： Pieter Kristian Brouwer ,  Marc Stephen Olson ,  Nachiappan Arumugam ,  Michael Thacker ,  Vijay Prasanth Rajavenkateswaran ,  Arpit Tripathi ,  Danny Wei

IPC: G06F3/01 ,  G06F13/42 ,  G06F13/40

CPC classification number: G06F13/4221 ,  G06F13/4068

Abstract: A user can set or modify operational parameters of a data volume stored on a network-accessible storage device in a data center. For example, the user may be provided access to a data volume and may request a modification to the operational parameters of the data volume. Instead of modifying the existing data volume, the data center can provision a new data volume and migrate data stored on the existing data volume to the new data volume. While the data migration takes place, the existing data volume may block input/output (I/O) requests and the new data volume may handle such requests instead. If a request is received for data not yet migrated to the new data volume, then the new data volume prioritizes a migration of the requested data.

公开(公告)号：US11467732B2

公开(公告)日：2022-10-11

申请号：US16723391

申请日：2019-12-20

Applicant: Amazon Technologies, Inc.

Inventor： Norbert P. Kusters ,  Nachiappan Arumugam ,  Christopher Nathan Watson ,  Marc John Brooker ,  David R. Richardson ,  Danny Wei ,  John Luther Guthrie, II

IPC: G06F3/06 ,  G06F12/0868 ,  H04L67/1095 ,  G11B33/12 ,  H03M13/15 ,  H04L67/2885 ,  H04L67/1097 ,  H04L67/568

Abstract: A data storage system includes multiple head nodes and multiple data storage sleds mounted in a rack. For a particular volume or volume partition one of the head nodes is designated as a primary head node for the volume or volume partition. The primary head node is configured to store data for the volume in a data storage of the primary head node and cause the data to be replicated to a secondary head node. The primary head node is also configured to cause the data for the volume to be stored in a plurality of respective mass storage devices each in different ones of the plurality of data storage sleds of the data storage system.

公开(公告)号：US11296981B2

公开(公告)日：2022-04-05

申请号：US16450720

申请日：2019-06-24

Applicant: Amazon Technologies, Inc.

Inventor： Stewart Allen ,  Andrew Davenport ,  Ciprian Dan Cosma ,  Anthony Nicholas Liguori ,  Joseph Elmar Magerramov ,  Nachiappan Arumugam

IPC: H04L12/721 ,  H04L45/00 ,  H04L47/70 ,  G06F9/455

Abstract: Indications of packet processing operations to be performed for packets of a resource group, as well as configuration settings of the group, are obtained. A packet that satisfies a requirement of the configuration settings and meets a fast path criterion is processed at a fast path node configured for the group. In response to determining that another packet does not satisfy a criterion for fast path processing, the other packet is transmitted to an exception path target.

公开(公告)号：US10514847B2

公开(公告)日：2019-12-24

申请号：US15392857

申请日：2016-12-28

Applicant: Amazon Technologies, Inc.

Inventor： Norbert P. Kusters ,  Nachiappan Arumugam ,  Christopher Nathan Watson ,  Marc John Brooker ,  David R. Richardson ,  Danny Wei ,  John Luther Guthrie, II

IPC: G06F3/06 ,  H04L29/08 ,  G06F12/0868 ,  G11B33/12 ,  H03M13/15

Abstract: A data storage system includes multiple head nodes and multiple data storage sleds mounted in a rack. For a particular volume or volume partition one of the head nodes is designated as a primary head node for the volume or volume partition. The primary head node is configured to store data for the volume in a data storage of the primary head node and cause the data to be replicated to a secondary head node. The primary head node is also configured to cause the data for the volume to be stored in a plurality of respective mass storage devices each in different ones of the plurality of data storage sleds of the data storage system.

公开(公告)号：US20190155694A1

公开(公告)日：2019-05-23

申请号：US16259571

申请日：2019-01-28

Applicant: Amazon Technologies, Inc.

Inventor： Jianhua Fan ,  Benjamin Arthur Hawks ,  Norbert Paul Kusters ,  Nachiappan Arumugam ,  Danny Wei ,  John Luther Guthrie

IPC: G06F11/14 ,  G06F3/06

CPC classification number: G06F11/1448 ,  G06F3/0605 ,  G06F3/0619 ,  G06F3/065 ,  G06F3/067 ,  G06F3/0689 ,  G06F11/1446 ,  G06F11/1464 ,  G06F11/1471 ,  G06F2201/84

Abstract: The present disclosure provides persistent storage for a master copy using operation numbers. A master copy can include a B-tree with references to corresponding data. When provisioning a slave copy, the master copy sends a point-in-time copy of the B-tree to the slave copy, which stores a copy of the B-tree, allocates the necessary space, and updates the references of the B-tree to point to a local storage before the data is transferred. When writing the data to persistent storage, a snapshot created on the master copy is an operation that is replicated to the slave copy. The snapshot is generated using a volume view that includes changes to chunks of data of the master copy since a previous snapshot, as determined using the operation number for the previous snapshot. Data (and metadata) for the snapshot is written to persistent storage while new I/O operations are processed.

公开(公告)号：US20170351462A1

公开(公告)日：2017-12-07

申请号：US15673271

申请日：2017-08-09

Applicant: Amazon Technologies, Inc.

Inventor： Jianhua Fan ,  Benjamin Arthur Hawks ,  Norbert Paul Kusters ,  Nachiappan Arumugam ,  Danny Wei ,  John Luther Guthrie, II

IPC: G06F3/06

CPC classification number: G06F3/0665 ,  G06F3/0619 ,  G06F3/065 ,  G06F3/067 ,  G06F11/1435

Abstract: A slave storage is provisioned using metadata of a master B-tree and updates to references (e.g., offsets) pertaining to data operations of the master B-tree. Master-slave pairs can be used to provide data redundancy, and a master copy can include the master B-tree with references to corresponding data. When provisioning a slave copy, the master sends a B-tree copy to the slave, which stores the slave B-tree copy, allocates the necessary space on local storage, and updates respective offsets of the slave B-tree copy to point to the local storage. Data from the master can then be transferred to the slave and stored according to a note and commit process that ensures operational sequence of the data. Operations received to the master during the process can be committed to the slave copy until the slave is consistent with the master and able to take over as master in the event of a failure.

公开(公告)号：US11411885B2

公开(公告)日：2022-08-09

申请号：US16660580

申请日：2019-10-22

Applicant: Amazon Technologies, Inc.

Inventor： Pieter Kristian Brouwer ,  Marc Stephen Olson ,  Nachiappan Arumugam ,  Michael Thacker ,  Vijay Prasanth Rajavenkateswaran ,  Arpit Tripathi ,  Danny Wei

IPC: H04L47/80

Abstract: A user can set or modify operational parameters of a data volume stored on a network-accessible storage device in a data center. For example, the user may be provided access to a data volume and may request a modification to the operational parameters of the data volume. Instead of modifying the existing data volume, the data center can provision a new data volume and migrate data stored on the existing data volume to the new data volume. While the data migration takes place, the existing data volume may block input/output (I/O) requests and the new data volume may handle such requests instead. Once the data migration is complete, the data center may deallocate the data blocks of the existing data volume such that the data blocks can be reused by other data volumes.