公开(公告)号：US10802921B2

公开(公告)日：2020-10-13

申请号：US16259571

申请日：2019-01-28

Applicant: Amazon Technologies, Inc.

Inventor： Jianhua Fan ,  Benjamin Arthur Hawks ,  Norbert Paul Kusters ,  Nachiappan Arumugam ,  Danny Wei ,  John Luther Guthrie

IPC: G06F3/06 ,  G06F11/14

Abstract: Systems and methods for provisioning a slave copy for redundant data storage and for writing data to persistent storage in a block-based storage system using sequential operation numbers are provided. In one embodiment, the method includes maintaining a master copy and a slave copy of a data volume, the master copy including data generated by a plurality of operations having respective sequential operation numbers, receiving a write instruction for second data to be added to the master copy, and recording the second data as a note that is not readable. The method may further include sending a copy of the note from the master copy to the slave copy, committing the note to the master copy with a sequential operation number, and committing the copy of the note to the slave copy based in part on the sequential operation number. A B-tree may be created based at least in part on an offset for a write instruction associated with the second data, a length, and an operation number included in the note.

公开(公告)号：US20190155694A1

公开(公告)日：2019-05-23

申请号：US16259571

申请日：2019-01-28

Applicant: Amazon Technologies, Inc.

Inventor： Jianhua Fan ,  Benjamin Arthur Hawks ,  Norbert Paul Kusters ,  Nachiappan Arumugam ,  Danny Wei ,  John Luther Guthrie

IPC: G06F11/14 ,  G06F3/06

CPC classification number: G06F11/1448 ,  G06F3/0605 ,  G06F3/0619 ,  G06F3/065 ,  G06F3/067 ,  G06F3/0689 ,  G06F11/1446 ,  G06F11/1464 ,  G06F11/1471 ,  G06F2201/84

Abstract: The present disclosure provides persistent storage for a master copy using operation numbers. A master copy can include a B-tree with references to corresponding data. When provisioning a slave copy, the master copy sends a point-in-time copy of the B-tree to the slave copy, which stores a copy of the B-tree, allocates the necessary space, and updates the references of the B-tree to point to a local storage before the data is transferred. When writing the data to persistent storage, a snapshot created on the master copy is an operation that is replicated to the slave copy. The snapshot is generated using a volume view that includes changes to chunks of data of the master copy since a previous snapshot, as determined using the operation number for the previous snapshot. Data (and metadata) for the snapshot is written to persistent storage while new I/O operations are processed.