公开(公告)号：US10592475B1

公开(公告)日：2020-03-17

申请号：US14222103

申请日：2014-03-21

Applicant: Amazon Technologies, Inc.

Inventor： Bogdan Eduard Ghidireac ,  Peter Sirota ,  Robert Frederick Leidle ,  Mathew Alan Mills ,  George Steven McPherson ,  Xing Wu ,  Jonathan Andrew Fritz

IPC: G06F16/182

Abstract: Methods and apparatus for providing consistent data storage in distributed computing systems. A consistent distributed computing file system (consistent DCFS) may be backed by an object storage service that only guarantees eventual consistency, and may leverage a data storage service (e.g., a database service) to store and maintain a file system/directory structure (a consistent DCFS directory) for the consistent DCFS that may be accessed by compute nodes for file/directory information relevant to the data objects in the consistent DCFS, rather than relying on the information maintained by the object storage service. The compute nodes may reference the consistent DCFS directory to, for example, store and retrieve strongly consistent metadata referencing data objects in the consistent DCFS. The compute nodes may, for example, retrieve metadata from consistent DCFS directory to determine whether the object storage service is presenting all of the data that it is supposed to have.

公开(公告)号：US20200218701A1

公开(公告)日：2020-07-09

申请号：US16818404

申请日：2020-03-13

Applicant: Amazon Technologies, Inc.

Inventor： Bogdan Eduard Ghidireac ,  Peter Sirota ,  Robert Frederick Leidle ,  Mathew Alan Mills ,  George Steven McPherson ,  Xing Wu ,  Jonathan Andrew Fritz

IPC: G06F16/182

Abstract: Methods and apparatus for providing consistent data storage in distributed computing systems. A consistent distributed computing file system (consistent DCFS) may be backed by an object storage service that only guarantees eventual consistency, and may leverage a data storage service (e.g., a database service) to store and maintain a file system/directory structure (a consistent DCFS directory) for the consistent DCFS that may be accessed by compute nodes for file/directory information relevant to the data objects in the consistent DCFS, rather than relying on the information maintained by the object storage service. The compute nodes may reference the consistent DCFS directory to, for example, store and retrieve strongly consistent metadata referencing data objects in the consistent DCFS. The compute nodes may, for example, retrieve metadata from consistent DCFS directory to determine whether the object storage service is presenting all of the data that it is supposed to have.

公开(公告)号：US10599621B1

公开(公告)日：2020-03-24

申请号：US14611980

申请日：2015-02-02

Applicant: Amazon Technologies, Inc.

Inventor： Xing Wu ,  George Steven McPherson ,  Robert Frederick Leidle ,  Jonathan Andrew Fritz

IPC: G06F17/30 ,  G06F16/182

Abstract: A system and method for improving the speed of generating a list of previously-uncounted items stored with a computing resource service provider. The system and method involve obtaining a set of keys from a data store, wherein each key of the set of keys corresponds to an item in a group of items, wherein a quantity of items in the group is uncounted. The system and method further includes generating a first sub-listing of keys based at least in part on a first key range of the set of keys by executing a first thread, generating a second sub-listing of keys based at least in part on a second key range of the set of keys by executing a second thread, combining the first sub-listing of keys with the second sub-listing of keys to produce a list of keys, and providing the list of keys.