公开(公告)号：US08751863B2

公开(公告)日：2014-06-10

申请号：US13113795

申请日：2011-05-23

申请人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Arild Einar Skjolsvold ,  Maxim Mazeev ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Hemal Khatri ,  Ju Wang ,  Padmanabha Chakravarthy Uddaraju ,  Leonidas Rigas

发明人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Arild Einar Skjolsvold ,  Maxim Mazeev ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Hemal Khatri ,  Ju Wang ,  Padmanabha Chakravarthy Uddaraju ,  Leonidas Rigas

IPC分类号： G06F11/00

CPC分类号： G06F11/2082 ,  G06F11/1471 ,  G06F11/1662 ,  G06F11/2094 ,  G06F11/2097

摘要： Embodiments of the present invention relate to invoking and managing a failover of a storage account between partitions within a distributed computing environment, where each partition represents a key range of data for the storage account. The partitions affected by the failover include source partitions hosted on a primary storage stamp and destination partitions hosted on a secondary storage stamp, where the storage account's data is being actively replicated from the primary to the secondary storage stamp. Upon receiving a manual or automatic indication to perform the failover, configuring the source partitions to independently perform flush-send operations (e.g., distributing pending messages as a group) and then configuring the destination partitions to independently perform flush-replay operations (e.g., aggressively replaying currently pending transactions). Upon completing the flush-replay operations, designating the secondary storage stamp as a new primary storage stamp such that live traffic is directed to the new primary storage stamp.

摘要翻译： 本发明的实施例涉及在分布式计算环境中的分区之间调用和管理存储帐户的故障切换，其中每个分区表示存储帐户的数据的关键范围。 受故障转移影响的分区包括托管在辅助存储戳记上托管的主存储戳记和目标分区上的源分区，其中存储帐户的数据正从主存储戳记主动复制。 在接收到手动或自动指示以执行故障切换时，将源分区配置为独立执行flush-send操作（例如，将挂起的消息作为一组分发），然后将目标分区配置为独立执行flush-replay操作（例如， 重播当前待处理的交易）。 在完成冲洗重放操作时，将辅助存储印记指定为新的主要存储印记，使得直播流量被定向到新的主存储印记。

公开(公告)号：US20120303791A1

公开(公告)日：2012-11-29

申请号：US13113776

申请日：2011-05-23

申请人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Padmanabha Chakravarthy Uddaraju ,  Arild Einar Skjolsvold ,  Hemal Khatri ,  Ju Wang

发明人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Padmanabha Chakravarthy Uddaraju ,  Arild Einar Skjolsvold ,  Hemal Khatri ,  Ju Wang

IPC分类号： G06F15/173

CPC分类号： G06F9/5083 ,  G06F2206/1012 ,  H04L67/1002

摘要： Embodiments of the present invention relate to invoking and managing load-balancing operation(s) applied to partitions within a distributed computing environment, where each partition represents a key range of data for a storage account. The partitions affected by the load-balancing operation(s) are source partitions hosted on a primary storage stamp and/or destination partitions hosted on a secondary storage stamp, where the primary and secondary storage stamps are located in geographically distinct areas and are equipped to replicate the storage account's data therebetween. The load-balancing operation(s) include splitting partitions into child partitions upon detecting an increased workload as a result of active replication, merging partitions to form parent partitions upon detecting a reduction in workload as a result of decreased processing-related resource consumption, or offloading partitions based on resource consumption. A service within a partition layer of the storage stamps is responsible for determining when to invoke these load-balancing operation(s).

摘要翻译： 本发明的实施例涉及调用和管理应用于分布式计算环境中的分区的负载平衡操作，其中每个分区表示存储帐户的数据的关键范围。 受负载平衡操作影响的分区是托管在辅助存储邮票上托管的主存储戳记和/或目标分区上的源分区，其中主存储邮票和辅助存储邮票位于地理位置不同的区域，并且被配置为 复制存储帐户之间的数据。 负载平衡操作包括在检测到作为主动复制的结果的增加的工作负载时将分区划分成子分区，在检测到与处理相关的资源消耗减少的结果中检测到工作负载的减少时，将分区合并以形成父分区;或 基于资源消耗卸载分区。 存储标记的分区层内的服务负责确定何时调用这些负载平衡操作。

公开(公告)号：US20140258499A9

公开(公告)日：2014-09-11

申请号：US13113776

申请日：2011-05-23

申请人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Padmanabha Chakravarthy Uddaraju ,  Arild Einar Skjolsvold ,  Hemal Khatri ,  Ju Wang

发明人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Padmanabha Chakravarthy Uddaraju ,  Arild Einar Skjolsvold ,  Hemal Khatri ,  Ju Wang

IPC分类号： G06F15/173

CPC分类号： G06F9/5083 ,  G06F2206/1012 ,  H04L67/1002

摘要： Embodiments of the present invention relate to invoking and managing load-balancing operation(s) applied to partitions within a distributed computing environment, where each partition represents a key range of data for a storage account. The partitions affected by the load-balancing operation(s) are source partitions hosted on a primary storage stamp and/or destination partitions hosted on a secondary storage stamp, where the primary and secondary storage stamps are located in geographically distinct areas and are equipped to replicate the storage account's data therebetween. The load-balancing operation(s) include splitting partitions into child partitions upon detecting an increased workload as a result of active replication, merging partitions to form parent partitions upon detecting a reduction in workload as a result of decreased processing-related resource consumption, or offloading partitions based on resource consumption. A service within a partition layer of the storage stamps is responsible for determining when to invoke these load-balancing operation(s).

摘要翻译： 本发明的实施例涉及调用和管理应用于分布式计算环境中的分区的负载平衡操作，其中每个分区表示存储帐户的数据的关键范围。 受负载均衡操作影响的分区是托管在辅助存储印记上托管的主存储印记和/或目标分区上的源分区，其中主存储邮票和辅助存储邮票位于地理位置不同的区域，并且配备为 复制存储帐户之间的数据。 负载平衡操作包括在检测到作为主动复制的结果的增加的工作负载时将分区划分成子分区，在检测到与处理相关的资源消耗减少的结果中检测到工作负载的减少时，将分区合并以形成父分区;或 基于资源消耗卸载分区。 存储标记的分区层内的服务负责确定何时调用这些负载平衡操作。

公开(公告)号：US08886796B2

公开(公告)日：2014-11-11

申请号：US13113776

申请日：2011-05-23

申请人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Padmanabha Chakravarthy Uddaraju ,  Arild Einar Skjolsvold ,  Hemal Khatri ,  Ju Wang

发明人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Padmanabha Chakravarthy Uddaraju ,  Arild Einar Skjolsvold ,  Hemal Khatri ,  Ju Wang

IPC分类号： G06F15/173 ,  G06F9/50 ,  H04L29/08

CPC分类号： G06F9/5083 ,  G06F2206/1012 ,  H04L67/1002

摘要： Embodiments of the present invention relate to invoking and managing load-balancing operation(s) applied to partitions within a distributed computing environment, where each partition represents a key range of data for a storage account. The partitions affected by the load-balancing operation(s) are source partitions hosted on a primary storage stamp and/or destination partitions hosted on a secondary storage stamp, where the primary and secondary storage stamps are located in geographically distinct areas and are equipped to replicate the storage account's data therebetween. The load-balancing operation(s) include splitting partitions into child partitions upon detecting an increased workload as a result of active replication, merging partitions to form parent partitions upon detecting a reduction in workload as a result of decreased processing-related resource consumption, or offloading partitions based on resource consumption. A service within a partition layer of the storage stamps is responsible for determining when to invoke these load-balancing operation(s).

摘要翻译： 本发明的实施例涉及调用和管理应用于分布式计算环境中的分区的负载平衡操作，其中每个分区表示存储帐户的数据的关键范围。 受负载平衡操作影响的分区是托管在辅助存储邮票上托管的主存储戳记和/或目标分区上的源分区，其中主存储邮票和辅助存储邮票位于地理位置不同的区域，并且被配置为 复制存储帐户之间的数据。 负载平衡操作包括在检测到作为主动复制的结果的增加的工作负载时将分区划分成子分区，在检测到与处理相关的资源消耗减少的结果中检测到工作负载的减少时，将分区合并以形成父分区;或 基于资源消耗卸载分区。 存储标记的分区层内的服务负责确定何时调用这些负载平衡操作。

公开(公告)号：US20120303999A1

公开(公告)日：2012-11-29

申请号：US13113795

申请日：2011-05-23

申请人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Arild Einar Skjolsvold ,  Maxim Mazeev ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Hemal Khatri ,  Ju Wang ,  Padmanabha Chakravarthy Uddaraju ,  Leonidas Rigas

发明人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Arild Einar Skjolsvold ,  Maxim Mazeev ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Hemal Khatri ,  Ju Wang ,  Padmanabha Chakravarthy Uddaraju ,  Leonidas Rigas

IPC分类号： G06F11/20

CPC分类号： G06F11/2082 ,  G06F11/1471 ,  G06F11/1662 ,  G06F11/2094 ,  G06F11/2097

摘要： Embodiments of the present invention relate to invoking and managing a failover of a storage account between partitions within a distributed computing environment, where each partition represents a key range of data for the storage account. The partitions affected by the failover include source partitions hosted on a primary storage stamp and destination partitions hosted on a secondary storage stamp, where the storage account's data is being actively replicated from the primary to the secondary storage stamp. Upon receiving a manual or automatic indication to perform the failover, configuring the source partitions to independently perform flush-send operations (e.g., distributing pending messages as a group) and then configuring the destination partitions to independently perform flush-replay operations (e.g., aggressively replaying currently pending transactions). Upon completing the flush-replay operations, designating the secondary storage stamp as a new primary storage stamp such that live traffic is directed to the new primary storage stamp.

摘要翻译： 本发明的实施例涉及在分布式计算环境中的分区之间调用和管理存储帐户的故障切换，其中每个分区表示存储帐户的数据的关键范围。 受故障转移影响的分区包括托管在辅助存储戳记上托管的主存储戳记和目标分区上的源分区，其中存储帐户的数据正从主存储戳记主动复制。 在接收到手动或自动指示以执行故障切换时，将源分区配置为独立执行flush-send操作（例如，将挂起的消息作为一组分发），然后将目标分区配置为独立执行flush-replay操作（例如， 重播当前待处理的交易）。 在完成冲洗重放操作时，将辅助存储印记指定为新的主要存储印记，使得直播流量被定向到新的主存储印记。

公开(公告)号：US09098470B2

公开(公告)日：2015-08-04

申请号：US13113729

申请日：2011-05-23

申请人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Padmanabha Chakravarthy Uddaraju ,  Ju Wang ,  Hemal Khatri ,  Arild Skjolsvold ,  Harshawardhan Gadgil

发明人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Padmanabha Chakravarthy Uddaraju ,  Ju Wang ,  Hemal Khatri ,  Arild Skjolsvold ,  Harshawardhan Gadgil

IPC分类号： G06F7/00 ,  G06F17/00 ,  G06F11/20 ,  G06F17/30

CPC分类号： G06F17/30215 ,  G06F11/2094 ,  G06F17/30176 ,  G06F17/30575 ,  G06F17/30589

摘要： Presented herein are methods of replicating versioned and hierarchical data structures, as well as data structures representing complex transactions. Due to interdependencies between data entities and a lack of guaranteed message ordering, simple replication methods employed for simple data types cannot be used. Operations on data structures exhibit dependencies between the messages making up the operations. This strategy can be extended to various types of complex transactions by considering certain messages to depend on other messages or on the existence of other entries at the data store. Regardless of origin, these dependencies can be enforced by suspending the processing of messages with unsatisfied dependencies until all of its dependencies have been met. Alternately, transactions can be committed immediately, creating entities that include versioned identifiers for each of their dependencies. These entities can then be garbage collected of the parent objects are not subsequently created.

摘要翻译： 这里呈现的是复制版本化和分层数据结构以及表示复杂事务的数据结构的方法。 由于数据实体之间的相互依赖关系和缺乏有保证的消息排序，简单数据类型采用简单的复制方法是不可能的。 对数据结构的操作表现出构成操作的消息之间的依赖关系。 该策略可以通过考虑某些消息来依赖于其他消息或数据存储上的其他条目的存在来扩展到各种类型的复杂事务。 无论起源是什么，这些依赖关系可以通过暂停处理具有不满足依赖性的消息来实现，直到其所有依赖关系得到满足。 或者，可以立即提交事务，创建包含每个依赖关系的版本标识符的实体。 这些实体然后可以被垃圾收集的父对象不后来被创建。

公开(公告)号：US20120303578A1

公开(公告)日：2012-11-29

申请号：US13113729

申请日：2011-05-23

申请人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Padmanabha Chakravarthy Uddaraju ,  Ju Wang ,  Hemal Khatri ,  Arild Skjolsvold ,  Harshawardhan Gadgil

发明人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Padmanabha Chakravarthy Uddaraju ,  Ju Wang ,  Hemal Khatri ,  Arild Skjolsvold ,  Harshawardhan Gadgil

IPC分类号： G06F17/30 ,  G06F7/00

CPC分类号： G06F17/30215 ,  G06F11/2094 ,  G06F17/30176 ,  G06F17/30575 ,  G06F17/30589

摘要： Presented herein are methods of replicating versioned and hierarchical data structures, as well as data structures representing complex transactions. Due to interdependencies between data entities and a lack of guaranteed message ordering, simple replication methods employed for simple data types cannot be used. Operations on data structures exhibit dependencies between the messages making up the operations. This strategy can be extended to various types of complex transactions by considering certain messages to depend on other messages or on the existence of other entries at the data store. Regardless of origin, these dependencies can be enforced by suspending the processing of messages with unsatisfied dependencies until all of its dependencies have been met. Alternately, transactions can be committed immediately, creating entities that include versioned identifiers for each of their dependencies. These entities can then be garbage collected of the parent objects are not subsequently created.

摘要翻译： 这里呈现的是复制版本化和分层数据结构以及表示复杂事务的数据结构的方法。 由于数据实体之间的相互依赖关系和缺乏有保证的消息排序，简单数据类型采用简单的复制方法是不可能的。 对数据结构的操作表现出构成操作的消息之间的依赖关系。 该策略可以通过考虑某些消息来依赖于其他消息或数据存储上的其他条目的存在来扩展到各种类型的复杂事务。 无论起源是什么，这些依赖关系可以通过暂停处理具有不满足依赖性的消息来实现，直到其所有依赖关系得到满足。 或者，可以立即提交事务，创建包含每个依赖关系的版本标识符的实体。 这些实体然后可以被垃圾收集的父对象不后来被创建。

公开(公告)号：US20120303912A1

公开(公告)日：2012-11-29

申请号：US13113808

申请日：2011-05-23

申请人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Arild Einar Skjolsvold ,  Maxim Mazeev ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Hemal Khatri ,  Ju Wang

发明人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Arild Einar Skjolsvold ,  Maxim Mazeev ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Hemal Khatri ,  Ju Wang

IPC分类号： G06F12/16

CPC分类号： G06F11/2094 ,  G06F3/0623 ,  G06F3/0647 ,  G06F3/067 ,  G06F11/2097

摘要： Embodiments of the present invention relate to invoking and managing migration operations applied to partitions within a distributed computing environment, where each partition represents a key range of data for a storage account. The partitions affected by the migration operations are source partitions hosted on a primary storage stamp and/or destination partitions hosted on a secondary storage stamp, where the primary and secondary storage stamps are equipped to replicate the storage account's data therebetween upon initiating a migration. Upon substantial completion of a bootstrapping phase of replication, one migration operation includes designating the secondary storage stamp as a new primary storage stamp such that the destination partitions commence processing client requests, sending resultant transactions to the source partitions, and providing read and write access thereto. Another migration operation includes designating the primary storage stamp as a new secondary storage stamp such that the source partitions commence replaying the transactions.

摘要翻译： 本发明的实施例涉及调用和管理应用于分布式计算环境中的分区的迁移操作，其中每个分区表示存储帐户的数据的关键范围。 由迁移操作影响的分区是托管在辅助存储戳记上托管的主存储戳记和/或目标分区上的源分区，主存储戳记和辅助存储戳记在启动迁移时可以复制存储帐户的数据。 在大量完成复制的引导阶段之后，一个迁移操作包括将辅助存储标记指定为新的主存储标记，使得目的地分区开始处理客户端请求，将结果事务发送到源分区，并提供对其的读取和写入访问 。 另一个迁移操作包括将主存储戳记指定为新的辅助存储戳，使得源分区开始重播事务。

公开(公告)号：US09251021B2

公开(公告)日：2016-02-02

申请号：US13113688

申请日：2011-05-23

申请人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Padmanabha Chakravarthy Uddaraju

发明人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Padmanabha Chakravarthy Uddaraju

IPC分类号： G06F17/30 ,  G06F11/20

CPC分类号： G06F17/30578 ,  G06F11/2074 ,  G06F11/2097 ,  G06F17/30241 ,  G06F17/30584 ,  G06F17/30589 ,  G06F2201/855

摘要： Embodiments of the present invention relate to asynchronously replicating data in a distributed computing environment. To achieve asynchronous replication, data received at a primary data store may be annotated with information, such as an identifier of the data. The annotated data may then be communicated to a secondary data store, which may then write the data and annotated information to one or more logs for eventual replay and committal at the secondary data store. The primary data store may communicate an acknowledgment of success in committing the data at the primary data store as well as of success in writing the data to the secondary data store. Additional embodiments may include committing the data at the secondary data store in response to receiving an instruction that authorizes committal of data through a identifier.

摘要翻译： 本发明的实施例涉及在分布式计算环境中异步复制数据。 为了实现异步复制，在主数据存储处接收到的数据可以用诸如数据的标识符的信息来注释。 然后可以将注释的数据传送到辅助数据存储器，然后辅助数据存储器可以将数据和注释的信息写入一个或多个日志以在次要数据存储器上最终重放和提交。 主数据存储器可以在主数据存储器上传送提交数据的成功确认以及将数据写入辅助数据存储器的成功。 另外的实施例可以包括在辅助数据存储器处响应于接收授权通过标识符提交数据的指令来提交数据。

公开(公告)号：US08762336B2

公开(公告)日：2014-06-24

申请号：US13113634

申请日：2011-05-23

申请人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Padmanabha Chakravarthy Uddaraju

发明人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Padmanabha Chakravarthy Uddaraju

IPC分类号： G06F7/00 ,  G06F17/00

CPC分类号： G06F11/1004 ,  G06F17/30575

摘要： Presented herein are methods of continuously verifying data and repairing errors introduced during replication. In a particular embodiment, a primary data store sends out information sufficient to create a checkpoint together with a checksum for the data being verified at that checkpoint. At the secondary data store, a checkpoint is created in accordance with the checkpointing information, and a checksum is calculated over the indicated data at the created checkpoint. If the calculated checksum disagrees with the received checksum, additional checksums are calculated over subranges of the indicated data and compared with corresponding checksums over the data at the primary data store. The checksums at the primary data store may be requested from the primary data store or calculated locally based on the received overall checksum. Once an erroneous entry is identified, it can then be re-replicated from the primary data store to restore data consistency.

摘要翻译： 这里提出的是连续验证数据和修复复制期间引入的错误的方法。 在特定实施例中，主数据存储器发出足以创建检查点的信息以及在该检查点处正在验证的数据的校验和。 在次级数据存储中，根据检查点信息创建检查点，并且在创建的检查点处对指示的数据计算校验和。 如果计算的校验和与接收到的校验和不一致，则在指定数据的子范围内计算额外的校验和，并与主数据存储器上的数据相对应的校验和进行比较。 可以从主数据存储器请求主数据存储器上的校验和，或者基于接收到的总体校验和在本地计算。 一旦识别出错误的条目，它就可以从主数据存储重新复制，以恢复数据的一致性。