公开(公告)号：US10338972B1

公开(公告)日：2019-07-02

申请号：US14289353

申请日：2014-05-28

Applicant: Amazon Technologies, Inc.

Inventor： Alazel Acheson ,  Meng Hu ,  Nauman Zubaid Khan ,  Mai-Lan Tomsen Bukovec

IPC: G06F9/50 ,  G06N7/00

Abstract: A computing resource service provider may store user data in a distributed data storage system. The distributed data storage system may contain one or more storage partitions configured to store based at least in part on prefixes of keys contained in a key-value store, where the size of the keys may vary. The one or more storage partitions may track requests to access data where the requests include a key such that the data may be located by the service provider based at least in part on the key. When a request is received a counter associated with the prefix included in the request may be incremented, the counter may be configured to decay over time. If the counter exceeds a threshold the service provider may split the prefix associated with the counter and generate new partitions responsible for the split prefix.

公开(公告)号：US20190354455A1

公开(公告)日：2019-11-21

申请号：US16530650

申请日：2019-08-02

Applicant: Amazon Technologies, Inc.

Inventor： Alazel Acheson ,  Meng Hu ,  Nauman Zubaid Khan ,  Mai-Lan Tomsen Bukovec

IPC: G06F11/267

Abstract: A computing resource service provider may store user data in a distributed data storage system. The distributed data storage system may contain one or more storage partitions configured to store based at least in part on prefixes of keys contained in a key-value store, where the size of the keys may vary. The one or more storage partitions may track requests to access data where the requests include a key such that the data may be located by the service provider based at least in part on the key. When a request is received a skew value associated with the key included in the request may be determined. The skew value may be determined based at least in part on the ratio of rate estimators, where the rate estimators represent a weighted average of the movement of the keys in a key space. If the skew value exceeds a threshold the service provider may take mitigating action.

公开(公告)号：US10372574B1

公开(公告)日：2019-08-06

申请号：US14307377

申请日：2014-06-17

Applicant: Amazon Technologies, Inc.

Inventor： Alazel Acheson ,  Meng Hu ,  Nauman Zubaid Khan ,  Mai-Lan Tomsen Bukovec

IPC: G06F17/30 ,  G06F11/267

Abstract: A computing resource service provider may store user data in a distributed data storage system. The distributed data storage system may contain one or more storage partitions configured to store based at least in part on prefixes of keys contained in a key-value store, where the size of the keys may vary. The one or more storage partitions may track requests to access data where the requests include a key such that the data may be located by the service provider based at least in part on the key. When a request is received a skew value associated with the key included in the request may be determined. The skew value may be determined based at least in part on the ratio of rate estimators, where the rate estimators represent a weighted average of the movement of the keys in a key space. If the skew value exceeds a threshold the service provider may take mitigating action.

公开(公告)号：US11126520B2

公开(公告)日：2021-09-21

申请号：US16530650

申请日：2019-08-02

Applicant: Amazon Technologies, Inc.

Inventor： Alazel Acheson ,  Meng Hu ,  Nauman Zubaid Khan ,  Mai-Lan Tomsen Bukovec

IPC: G06F16/00 ,  G06F11/267 ,  G06F3/00 ,  G06F16/23

Abstract: A computing resource service provider may store user data in a distributed data storage system. The distributed data storage system may contain one or more storage partitions configured to store based at least in part on prefixes of keys contained in a key-value store, where the size of the keys may vary. The one or more storage partitions may track requests to access data where the requests include a key such that the data may be located by the service provider based at least in part on the key. When a request is received a skew value associated with the key included in the request may be determined. The skew value may be determined based at least in part on the ratio of rate estimators, where the rate estimators represent a weighted average of the movement of the keys in a key space. If the skew value exceeds a threshold the service provider may take mitigating action.