-
公开(公告)号:US10983719B1
公开(公告)日:2021-04-20
申请号:US16367956
申请日:2019-03-28
Applicant: Amazon Technologies, Inc.
Inventor: Colin Williams , Christopher Magee Greenwood , Sonal Agarwal , Gautham Narayanasamy , Mark Robinson , Kristina Brenneman , Linlin Ding
Abstract: Generally described, aspects of the present application correspond to enabling rapid duplication of data within a data volume hosted on a network storage system. The network storage system can maintain a highly distributed replica pool of the data volume, include a number of replicas duplicating data of the data volume. By providing increased parallelization, the replica pool can facilitate rapid duplication of the volume. In one configuration, each partition of a new volume is mapped to an individual replica within the replica pool, which supports population of the partition with data. Each replica can further include a set of replica partitions, such that read requests from each partition of a new volume are distributed among a number of servers to provide additional parallelization.
-
公开(公告)号:US10452296B1
公开(公告)日:2019-10-22
申请号:US15934608
申请日:2018-03-23
Applicant: Amazon Technologies, Inc.
Inventor: Christopher Magee Greenwood , Kiran-Kumar Muniswamy-Reddy , Igor A Kostic , Wells Lin , Danny Wei , Colin Williams
IPC: G06F3/06 , H04L29/08 , G06F9/4401 , G06F9/50 , G06F16/11
Abstract: A snapshot object or other type of object may be stored in a first storage system and may be accelerated in another storage system, wherein an accelerated snapshot or other type of object can be used to populate volumes in the other storage system with data more rapidly than a non-accelerated snapshot or other type of object. The accelerated snapshot or other object may be implemented using an intermediate volume implemented in the other storage system that is populated with data from the snapshot object or the other object stored in the first storage system.
-
公开(公告)号:US11023157B2
公开(公告)日:2021-06-01
申请号:US15967284
申请日:2018-04-30
Applicant: Amazon Technologies, Inc.
Inventor: Christopher Magee Greenwood , Danny Wei , Kiran-Kumar Muniswamy-Reddy , Wells Lin , Igor A. Kostic , Colin Williams
Abstract: Generally described, aspects of the present application correspond to enabling rapid duplication of data within a data volume hosted on a network storage system. The network storage system can maintain a highly distributed replica of the data volume, designated for duplication of data within the volume and separate from one or more other replicas designated for handling modifications to the data volume. By providing increased parallelization, the highly distributed replica can facilitate rapid duplication of the volume. When a sufficiently large request to duplicate the data volume is received, the system can create additional duplicate portions of the volume to further increase parallelization. For example, a partition of the highly distributed replica may be repeatedly duplicated to create a large number of intermediary duplicate partitions. The intermediary duplicate partitions can then be used to service the duplication request rapidly, due to increased parallelism.
-
公开(公告)号:US10956442B1
公开(公告)日:2021-03-23
申请号:US16049625
申请日:2018-07-30
Applicant: Amazon Technologies, Inc.
Inventor: Pavel Labovich , Colin Williams
Abstract: Generally described, one or more aspects of the present application correspond to techniques for new block store volumes of data from object storage snapshots of an origin volume by creating an intermediary “acceleration pool” of source volumes reserved for supporting the new volume creation process. The source volumes may be prevented from supporting user I/O or computing instances in order to reserve their bandwidth for the transfer of data to the new volumes. In addition, the source volumes can be stored on block store servers to increase the speed with which their data can be transferred to the new volumes. The acceleration pool can be partitioned among users accessing the pool in order to maintain availability even when some users heavily utilize the acceleration pool, with particular source volumes intelligently selected from among a user's partition in order to optimize the speed at which the new volumes are created.
-
公开(公告)号:US20190332269A1
公开(公告)日:2019-10-31
申请号:US15967284
申请日:2018-04-30
Applicant: Amazon Technologies, Inc.
Inventor: Christopher Magee Greenwood , Danny Wei , Kiran-Kumar Muniswamy-Reddy , Wells Lin , Igor A. Kostic , Colin Williams
IPC: G06F3/06
Abstract: Generally described, aspects of the present application correspond to enabling rapid duplication of data within a data volume hosted on a network storage system. The network storage system can maintain a highly distributed replica of the data volume, designated for duplication of data within the volume and separate from one or more other replicas designated for handling modifications to the data volume. By providing increased parallelization, the highly distributed replica can facilitate rapid duplication of the volume. When a sufficiently large request to duplicate the data volume is received, the system can create additional duplicate portions of the volume to further increase parallelization. For example, a partition of the highly distributed replica may be repeatedly duplicated to create a large number of intermediary duplicate partitions. The intermediary duplicate partitions can then be used to service the duplication request rapidly, due to increased parallelism.
-
公开(公告)号:US11076027B1
公开(公告)日:2021-07-27
申请号:US16208148
申请日:2018-12-03
Applicant: Amazon Technologies, Inc.
Inventor: Nathan William Sharp , Christopher Magee Greenwood , Pavel Labovich , Colin Williams , Ashritha Nagavaram
Abstract: Techniques for selecting a network communications protocol based on network topology and/or network performance are described. A first application executing on a first computer system obtains a distance characteristic of a network coupling the first computer system to a second computer system. The first application selects a network communications protocol from a plurality of network communications protocols based on the distance characteristic of the network. The first application and the second application connect with the selected network communications protocol. In some embodiments, the distance characteristic of the network may be based on topological or performance characteristics of the network.
-
公开(公告)号:US10768850B2
公开(公告)日:2020-09-08
申请号:US15967023
申请日:2018-04-30
Applicant: Amazon Technologies, Inc.
Inventor: Kiran-Kumar Muniswamy-Reddy , Christopher Magee Greenwood , Colin Williams , Wells Lin , Danny Wei , Igor A. Kostic
Abstract: Generally described, one or more aspects of the present application correspond to a highly distributed replica of a volume stored in a networked computing environment. First and second replicas of the volume can be synchronously replicated, and some implementations of the tertiary replica can be asynchronously replicated. The highly distributed nature of the tertiary replica supports parallel data transfer of the data of the volume, resulting in faster creation of backups and new copies of the volume.
-
公开(公告)号:US11182095B2
公开(公告)日:2021-11-23
申请号:US16663159
申请日:2019-10-24
Applicant: Amazon Technologies, Inc.
Inventor: Christopher Magee Greenwood , Colin Williams , Kiran-Kumar Muniswamy-Reddy , Danny Wei , Wells Lin , Igor A. Kostic
Abstract: Generally described, one or more aspects of the present application correspond to a highly distributed replica of a volume stored in a networked elastic computing environment. First and second replicas of the volume can be synchronously replicated, and some implementations of the tertiary replica can be asynchronously replicated. The highly distributed nature of the tertiary replica supports parallel data transfer of the data of the volume, resulting in faster creation of backups and new copies of the volume.
-
公开(公告)号:US11093148B1
公开(公告)日:2021-08-17
申请号:US16550097
申请日:2019-08-23
Applicant: Amazon Technologies, Inc.
Inventor: Christopher Magee Greenwood , Kiran-Kumar Muniswamy-Reddy , Igor A. Kostic , Wells Lin , Danny Wei , Colin Williams
IPC: G06F3/06 , G06F16/11 , G06F9/4401 , H04L29/08 , G06F9/50
Abstract: A snapshot object or other type of object may be stored in a first storage system and may be accelerated in another storage system, wherein an accelerated snapshot or other type of object can be used to populate volumes in the other storage system with data more rapidly than a non-accelerated snapshot or other type of object. The accelerated snapshot or other object may be implemented using an intermediate volume implemented in the other storage system that is populated with data from the snapshot object or the other object stored in the first storage system.
-
10.
公开(公告)号:US10931750B1
公开(公告)日:2021-02-23
申请号:US16049620
申请日:2018-07-30
Applicant: Amazon Technologies, Inc.
Inventor: Pavel Labovich , Colin Williams
Abstract: Generally described, one or more aspects of the present application correspond to techniques for new block store volumes of data from object storage snapshots of an origin volume by creating an intermediary “acceleration pool” of source volumes reserved for supporting the new volume creation process. The source volumes may be prevented from supporting user I/O or computing instances in order to reserve their bandwidth for the transfer of data to the new volumes. In addition, the source volumes can be stored on block store servers to increase the speed with which their data can be transferred to the new volumes. The acceleration pool can be partitioned among users accessing the pool in order to maintain availability even when some users heavily utilize the acceleration pool, with particular source volumes intelligently selected from among a user's partition in order to optimize the speed at which the new volumes are created.
-
-
-
-
-
-
-
-
-