-
公开(公告)号:US20210089238A1
公开(公告)日:2021-03-25
申请号:US16579614
申请日:2019-09-23
Applicant: Amazon Technologies, Inc.
Inventor: Kiran-Kumar Muniswamy-Reddy , Danny Wei , Norbert Paul Kusters , Romain Benoit Seguy , Rahul Upadhyaya , Divya Ashok Kumar Jain , William Zaharchuk , Wells Lin
Abstract: The present disclosure generally relates to creating virtualized block storage devices whose data is replicated across isolated computing systems to lower risk of data loss even in wide-scale events, such as natural disasters. The virtualized device can include at least two volumes, each of which is implemented in a distinct computing system. Each volume can be implemented by at least two computing devices, a first of which is configured as a primary device to which reads from and writes to the volume are directed. To ensure consistency in the distributed device, a multi-tier authority service is implemented, in which a cross-computing system authority service designates a volume as having authority to accept writes to the virtualized device, and in which a second tier authority service designates a computing device as having authority to accept writes to the volume.
-
公开(公告)号:US20210089210A1
公开(公告)日:2021-03-25
申请号:US16579620
申请日:2019-09-23
Applicant: Amazon Technologies, Inc.
Inventor: Romain Benoit Seguy , Rahul Upadhyaya , Kiran-Kumar Muniswamy-Reddy , Wells Lin , Divya Ashok Kumar Jain , William Zaharchuk
Abstract: The present disclosure generally relates to creating virtualized block storage devices whose data is replicated across isolated computing systems to lower risk of data loss even in wide-scale events, such as natural disasters. The virtualized device can include at least two volumes, each of which is implemented in a distinct computing system. Due to separation between volumes, replication lag may occur, in which data persisted to a first volume is not immediately persisted to a second volume. Such lag can increase a potential for data loss in the event that the first volume fails. Embodiments of the present disclosure relate to managing data loss risk by determining an expected maximum difference between the data stored at the two volumes, in a manner that does not require decrypting the data written to the volumes or perfect knowledge of the state of the distributed system at a single point.
-
公开(公告)号:US20190332268A1
公开(公告)日:2019-10-31
申请号:US15967025
申请日:2018-04-30
Applicant: Amazon Technologies, Inc.
Inventor: Christopher Magee Greenwood , Colin Williams , Kiran-Kumar Muniswamy-Reddy , Danny Wei , Wells Lin , Igor A. Kostic
Abstract: Generally described, one or more aspects of the present application correspond to a highly distributed replica of a volume stored in a networked elastic computing environment. First and second replicas of the volume can be synchronously replicated, and some implementations of the tertiary replica can be asynchronously replicated. The highly distributed nature of the tertiary replica supports parallel data transfer of the data of the volume, resulting in faster creation of backups and new copies of the volume.
-
公开(公告)号:US20190332267A1
公开(公告)日:2019-10-31
申请号:US15967023
申请日:2018-04-30
Applicant: Amazon Technologies, Inc.
Inventor: Kiran-Kumar Muniswamy-Reddy , Christopher Magee Greenwood , Colin Williams , Wells Lin , Danny Wei , Igor A. Kostic
Abstract: Generally described, one or more aspects of the present application correspond to a highly distributed replica of a volume stored in a networked computing environment. First and second replicas of the volume can be synchronously replicated, and some implementations of the tertiary replica can be asynchronously replicated. The highly distributed nature of the tertiary replica supports parallel data transfer of the data of the volume, resulting in faster creation of backups and new copies of the volume.
-
公开(公告)号:US10459655B1
公开(公告)日:2019-10-29
申请号:US15967025
申请日:2018-04-30
Applicant: Amazon Technologies, Inc.
Inventor: Christopher Magee Greenwood , Colin Williams , Kiran-Kumar Muniswamy-Reddy , Danny Wei , Wells Lin , Igor A. Kostic
Abstract: Generally described, one or more aspects of the present application correspond to a highly distributed replica of a volume stored in a networked elastic computing environment. First and second replicas of the volume can be synchronously replicated, and some implementations of the tertiary replica can be asynchronously replicated. The highly distributed nature of the tertiary replica supports parallel data transfer of the data of the volume, resulting in faster creation of backups and new copies of the volume.
-
公开(公告)号:US09489443B1
公开(公告)日:2016-11-08
申请号:US13902419
申请日:2013-05-24
Applicant: Amazon Technologies, Inc.
Inventor: Kiran-Kumar Muniswamy-Reddy , Wei Xiao , Stefano Stefani , Xianglong Huang , Clarence Wing Yin Ng , Jai Vasanth
IPC: G06F17/30
CPC classification number: G06F17/30584 , G06F17/30575
Abstract: A system that implements a data storage service may store data in multiple replicated partitions on respective computing nodes on behalf of clients. A storage node may, based on the amount of provisioned resources on a given storage device or logical volume, identify candidate partition management operations to be performed, and may send information about the operations to a central partition management scheduler. The scheduler may apply a global prioritization scheme to determine an order in which to perform the candidate operations. The order may be based on whether the operations include partition splits or partition moves, whether they aim to reduce provisioned storage capacity or reduce throughput capacity on a storage device or logical volume, whether they conflict with each other, whether the total number of partitions (or replicas thereof) involved in partition management at any given time exceeds a pre-determined limit, or whether they were requested by clients.
Abstract translation: 实现数据存储服务的系统可以代表客户端将数据存储在各个计算节点上的多个复制分区中。 存储节点可以基于给定存储设备或逻辑卷上的供应资源量来识别要执行的候选分区管理操作,并且可以向中央分区管理调度器发送关于操作的信息。 调度器可以应用全局优先级方案来确定执行候选操作的顺序。 该顺序可以基于操作是否包括分区划分或分区移动,无论它们旨在减少存储设备或逻辑卷上的配置存储容量还是减少吞吐量容量,无论它们是否相互冲突,是否是分区的总数( 或其副本)在任何给定时间内涉及分区管理超过预定限制,或者是否被客户请求。
-
公开(公告)号:US20140344312A1
公开(公告)日:2014-11-20
申请号:US13897232
申请日:2013-05-17
Applicant: Amazon Technologies, Inc.
Inventor: David Craig Yanacek , Bjorn Patrick Swift , Wei Xiao , Kiran-Kumar Muniswamy-Reddy , Miguel Mascarenhas Filipe , Yijun Lu
IPC: G06F17/30
CPC classification number: G06F17/30595 , G06F17/30289 , G06F17/30386
Abstract: A database management system may be operated by a third-party provider that hosts the system in a datacenter and provides access to the system to end users on behalf of various entities. Limits on total capacity consumption may be imposed, but may result in service outages when capacity consumption exceeds those limits. Requests to perform operations on the system may be classified. The request classifications may be associated with policies for admitting or rejecting the request. One or more token buckets representative of capacity available to the request to perform the operation may be used to determine to admit the request and updated based on the cost of performing the operation.
Abstract translation: 数据库管理系统可以由在数据中心中承载系统的第三方提供商来操作,并且代表各种实体向终端用户提供对系统的访问。 总容量消耗的限制可能会受到限制,但是当容量消耗超过这些限制时可能导致服务中断。 可以对在系统上执行操作的请求进行分类。 请求分类可能与允许或拒绝请求的策略相关联。 可以使用表示可用于执行操作的请求的容量的一个或多个令牌桶来确定承认请求并且基于执行操作的成本来更新。
-
公开(公告)号:US11231885B2
公开(公告)日:2022-01-25
申请号:US16579614
申请日:2019-09-23
Applicant: Amazon Technologies, Inc.
Inventor: Kiran-Kumar Muniswamy-Reddy , Danny Wei , Norbert Paul Kusters , Romain Benoit Seguy , Rahul Upadhyaya , Divya Ashok Kumar Jain , William Zaharchuk , Wells Lin
Abstract: The present disclosure generally relates to creating virtualized block storage devices whose data is replicated across isolated computing systems to lower risk of data loss even in wide-scale events, such as natural disasters. The virtualized device can include at least two volumes, each of which is implemented in a distinct computing system. Each volume can be implemented by at least two computing devices, a first of which is configured as a primary device to which reads from and writes to the volume are directed. To ensure consistency in the distributed device, a multi-tier authority service is implemented, in which a cross-computing system authority service designates a volume as having authority to accept writes to the virtualized device, and in which a second tier authority service designates a computing device as having authority to accept writes to the volume.
-
公开(公告)号:US11182095B2
公开(公告)日:2021-11-23
申请号:US16663159
申请日:2019-10-24
Applicant: Amazon Technologies, Inc.
Inventor: Christopher Magee Greenwood , Colin Williams , Kiran-Kumar Muniswamy-Reddy , Danny Wei , Wells Lin , Igor A. Kostic
Abstract: Generally described, one or more aspects of the present application correspond to a highly distributed replica of a volume stored in a networked elastic computing environment. First and second replicas of the volume can be synchronously replicated, and some implementations of the tertiary replica can be asynchronously replicated. The highly distributed nature of the tertiary replica supports parallel data transfer of the data of the volume, resulting in faster creation of backups and new copies of the volume.
-
公开(公告)号:US11010089B2
公开(公告)日:2021-05-18
申请号:US16579620
申请日:2019-09-23
Applicant: Amazon Technologies, Inc.
Inventor: Romain Benoit Seguy , Rahul Upadhyaya , Kiran-Kumar Muniswamy-Reddy , Wells Lin , Divya Ashok Kumar Jain , William Zaharchuk
Abstract: The present disclosure generally relates to creating virtualized block storage devices whose data is replicated across isolated computing systems to lower risk of data loss even in wide-scale events, such as natural disasters. The virtualized device can include at least two volumes, each of which is implemented in a distinct computing system. Due to separation between volumes, replication lag may occur, in which data persisted to a first volume is not immediately persisted to a second volume. Such lag can increase a potential for data loss in the event that the first volume fails. Embodiments of the present disclosure relate to managing data loss risk by determining an expected maximum difference between the data stored at the two volumes, in a manner that does not require decrypting the data written to the volumes or perfect knowledge of the state of the distributed system at a single point.
-
-
-
-
-
-
-
-
-