公开(公告)号：US08751863B2

公开(公告)日：2014-06-10

申请号：US13113795

申请日：2011-05-23

申请人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Arild Einar Skjolsvold ,  Maxim Mazeev ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Hemal Khatri ,  Ju Wang ,  Padmanabha Chakravarthy Uddaraju ,  Leonidas Rigas

发明人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Arild Einar Skjolsvold ,  Maxim Mazeev ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Hemal Khatri ,  Ju Wang ,  Padmanabha Chakravarthy Uddaraju ,  Leonidas Rigas

IPC分类号： G06F11/00

CPC分类号： G06F11/2082 ,  G06F11/1471 ,  G06F11/1662 ,  G06F11/2094 ,  G06F11/2097

摘要： Embodiments of the present invention relate to invoking and managing a failover of a storage account between partitions within a distributed computing environment, where each partition represents a key range of data for the storage account. The partitions affected by the failover include source partitions hosted on a primary storage stamp and destination partitions hosted on a secondary storage stamp, where the storage account's data is being actively replicated from the primary to the secondary storage stamp. Upon receiving a manual or automatic indication to perform the failover, configuring the source partitions to independently perform flush-send operations (e.g., distributing pending messages as a group) and then configuring the destination partitions to independently perform flush-replay operations (e.g., aggressively replaying currently pending transactions). Upon completing the flush-replay operations, designating the secondary storage stamp as a new primary storage stamp such that live traffic is directed to the new primary storage stamp.

摘要翻译： 本发明的实施例涉及在分布式计算环境中的分区之间调用和管理存储帐户的故障切换，其中每个分区表示存储帐户的数据的关键范围。 受故障转移影响的分区包括托管在辅助存储戳记上托管的主存储戳记和目标分区上的源分区，其中存储帐户的数据正从主存储戳记主动复制。 在接收到手动或自动指示以执行故障切换时，将源分区配置为独立执行flush-send操作（例如，将挂起的消息作为一组分发），然后将目标分区配置为独立执行flush-replay操作（例如， 重播当前待处理的交易）。 在完成冲洗重放操作时，将辅助存储印记指定为新的主要存储印记，使得直播流量被定向到新的主存储印记。

公开(公告)号：US20120303999A1

公开(公告)日：2012-11-29

申请号：US13113795

申请日：2011-05-23

申请人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Arild Einar Skjolsvold ,  Maxim Mazeev ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Hemal Khatri ,  Ju Wang ,  Padmanabha Chakravarthy Uddaraju ,  Leonidas Rigas

发明人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Arild Einar Skjolsvold ,  Maxim Mazeev ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Hemal Khatri ,  Ju Wang ,  Padmanabha Chakravarthy Uddaraju ,  Leonidas Rigas

IPC分类号： G06F11/20

CPC分类号： G06F11/2082 ,  G06F11/1471 ,  G06F11/1662 ,  G06F11/2094 ,  G06F11/2097

摘要： Embodiments of the present invention relate to invoking and managing a failover of a storage account between partitions within a distributed computing environment, where each partition represents a key range of data for the storage account. The partitions affected by the failover include source partitions hosted on a primary storage stamp and destination partitions hosted on a secondary storage stamp, where the storage account's data is being actively replicated from the primary to the secondary storage stamp. Upon receiving a manual or automatic indication to perform the failover, configuring the source partitions to independently perform flush-send operations (e.g., distributing pending messages as a group) and then configuring the destination partitions to independently perform flush-replay operations (e.g., aggressively replaying currently pending transactions). Upon completing the flush-replay operations, designating the secondary storage stamp as a new primary storage stamp such that live traffic is directed to the new primary storage stamp.

摘要翻译： 本发明的实施例涉及在分布式计算环境中的分区之间调用和管理存储帐户的故障切换，其中每个分区表示存储帐户的数据的关键范围。 受故障转移影响的分区包括托管在辅助存储戳记上托管的主存储戳记和目标分区上的源分区，其中存储帐户的数据正从主存储戳记主动复制。 在接收到手动或自动指示以执行故障切换时，将源分区配置为独立执行flush-send操作（例如，将挂起的消息作为一组分发），然后将目标分区配置为独立执行flush-replay操作（例如， 重播当前待处理的交易）。 在完成冲洗重放操作时，将辅助存储印记指定为新的主要存储印记，使得直播流量被定向到新的主存储印记。

公开(公告)号：US20120303791A1

公开(公告)日：2012-11-29

申请号：US13113776

申请日：2011-05-23

申请人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Padmanabha Chakravarthy Uddaraju ,  Arild Einar Skjolsvold ,  Hemal Khatri ,  Ju Wang

发明人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Padmanabha Chakravarthy Uddaraju ,  Arild Einar Skjolsvold ,  Hemal Khatri ,  Ju Wang

IPC分类号： G06F15/173

CPC分类号： G06F9/5083 ,  G06F2206/1012 ,  H04L67/1002

摘要： Embodiments of the present invention relate to invoking and managing load-balancing operation(s) applied to partitions within a distributed computing environment, where each partition represents a key range of data for a storage account. The partitions affected by the load-balancing operation(s) are source partitions hosted on a primary storage stamp and/or destination partitions hosted on a secondary storage stamp, where the primary and secondary storage stamps are located in geographically distinct areas and are equipped to replicate the storage account's data therebetween. The load-balancing operation(s) include splitting partitions into child partitions upon detecting an increased workload as a result of active replication, merging partitions to form parent partitions upon detecting a reduction in workload as a result of decreased processing-related resource consumption, or offloading partitions based on resource consumption. A service within a partition layer of the storage stamps is responsible for determining when to invoke these load-balancing operation(s).

摘要翻译： 本发明的实施例涉及调用和管理应用于分布式计算环境中的分区的负载平衡操作，其中每个分区表示存储帐户的数据的关键范围。 受负载平衡操作影响的分区是托管在辅助存储邮票上托管的主存储戳记和/或目标分区上的源分区，其中主存储邮票和辅助存储邮票位于地理位置不同的区域，并且被配置为 复制存储帐户之间的数据。 负载平衡操作包括在检测到作为主动复制的结果的增加的工作负载时将分区划分成子分区，在检测到与处理相关的资源消耗减少的结果中检测到工作负载的减少时，将分区合并以形成父分区;或 基于资源消耗卸载分区。 存储标记的分区层内的服务负责确定何时调用这些负载平衡操作。

公开(公告)号：US20140258499A9

公开(公告)日：2014-09-11

申请号：US13113776

申请日：2011-05-23

申请人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Padmanabha Chakravarthy Uddaraju ,  Arild Einar Skjolsvold ,  Hemal Khatri ,  Ju Wang

发明人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Padmanabha Chakravarthy Uddaraju ,  Arild Einar Skjolsvold ,  Hemal Khatri ,  Ju Wang

IPC分类号： G06F15/173

CPC分类号： G06F9/5083 ,  G06F2206/1012 ,  H04L67/1002

摘要： Embodiments of the present invention relate to invoking and managing load-balancing operation(s) applied to partitions within a distributed computing environment, where each partition represents a key range of data for a storage account. The partitions affected by the load-balancing operation(s) are source partitions hosted on a primary storage stamp and/or destination partitions hosted on a secondary storage stamp, where the primary and secondary storage stamps are located in geographically distinct areas and are equipped to replicate the storage account's data therebetween. The load-balancing operation(s) include splitting partitions into child partitions upon detecting an increased workload as a result of active replication, merging partitions to form parent partitions upon detecting a reduction in workload as a result of decreased processing-related resource consumption, or offloading partitions based on resource consumption. A service within a partition layer of the storage stamps is responsible for determining when to invoke these load-balancing operation(s).

摘要翻译： 本发明的实施例涉及调用和管理应用于分布式计算环境中的分区的负载平衡操作，其中每个分区表示存储帐户的数据的关键范围。 受负载均衡操作影响的分区是托管在辅助存储印记上托管的主存储印记和/或目标分区上的源分区，其中主存储邮票和辅助存储邮票位于地理位置不同的区域，并且配备为 复制存储帐户之间的数据。 负载平衡操作包括在检测到作为主动复制的结果的增加的工作负载时将分区划分成子分区，在检测到与处理相关的资源消耗减少的结果中检测到工作负载的减少时，将分区合并以形成父分区;或 基于资源消耗卸载分区。 存储标记的分区层内的服务负责确定何时调用这些负载平衡操作。

公开(公告)号：US08886796B2

公开(公告)日：2014-11-11

申请号：US13113776

申请日：2011-05-23

申请人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Padmanabha Chakravarthy Uddaraju ,  Arild Einar Skjolsvold ,  Hemal Khatri ,  Ju Wang

发明人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Padmanabha Chakravarthy Uddaraju ,  Arild Einar Skjolsvold ,  Hemal Khatri ,  Ju Wang

IPC分类号： G06F15/173 ,  G06F9/50 ,  H04L29/08

CPC分类号： G06F9/5083 ,  G06F2206/1012 ,  H04L67/1002

摘要： Embodiments of the present invention relate to invoking and managing load-balancing operation(s) applied to partitions within a distributed computing environment, where each partition represents a key range of data for a storage account. The partitions affected by the load-balancing operation(s) are source partitions hosted on a primary storage stamp and/or destination partitions hosted on a secondary storage stamp, where the primary and secondary storage stamps are located in geographically distinct areas and are equipped to replicate the storage account's data therebetween. The load-balancing operation(s) include splitting partitions into child partitions upon detecting an increased workload as a result of active replication, merging partitions to form parent partitions upon detecting a reduction in workload as a result of decreased processing-related resource consumption, or offloading partitions based on resource consumption. A service within a partition layer of the storage stamps is responsible for determining when to invoke these load-balancing operation(s).

摘要翻译： 本发明的实施例涉及调用和管理应用于分布式计算环境中的分区的负载平衡操作，其中每个分区表示存储帐户的数据的关键范围。 受负载平衡操作影响的分区是托管在辅助存储邮票上托管的主存储戳记和/或目标分区上的源分区，其中主存储邮票和辅助存储邮票位于地理位置不同的区域，并且被配置为 复制存储帐户之间的数据。 负载平衡操作包括在检测到作为主动复制的结果的增加的工作负载时将分区划分成子分区，在检测到与处理相关的资源消耗减少的结果中检测到工作负载的减少时，将分区合并以形成父分区;或 基于资源消耗卸载分区。 存储标记的分区层内的服务负责确定何时调用这些负载平衡操作。

公开(公告)号：US20120303912A1

公开(公告)日：2012-11-29

申请号：US13113808

申请日：2011-05-23

申请人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Arild Einar Skjolsvold ,  Maxim Mazeev ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Hemal Khatri ,  Ju Wang

发明人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Arild Einar Skjolsvold ,  Maxim Mazeev ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Hemal Khatri ,  Ju Wang

IPC分类号： G06F12/16

CPC分类号： G06F11/2094 ,  G06F3/0623 ,  G06F3/0647 ,  G06F3/067 ,  G06F11/2097

摘要： Embodiments of the present invention relate to invoking and managing migration operations applied to partitions within a distributed computing environment, where each partition represents a key range of data for a storage account. The partitions affected by the migration operations are source partitions hosted on a primary storage stamp and/or destination partitions hosted on a secondary storage stamp, where the primary and secondary storage stamps are equipped to replicate the storage account's data therebetween upon initiating a migration. Upon substantial completion of a bootstrapping phase of replication, one migration operation includes designating the secondary storage stamp as a new primary storage stamp such that the destination partitions commence processing client requests, sending resultant transactions to the source partitions, and providing read and write access thereto. Another migration operation includes designating the primary storage stamp as a new secondary storage stamp such that the source partitions commence replaying the transactions.

摘要翻译： 本发明的实施例涉及调用和管理应用于分布式计算环境中的分区的迁移操作，其中每个分区表示存储帐户的数据的关键范围。 由迁移操作影响的分区是托管在辅助存储戳记上托管的主存储戳记和/或目标分区上的源分区，主存储戳记和辅助存储戳记在启动迁移时可以复制存储帐户的数据。 在大量完成复制的引导阶段之后，一个迁移操作包括将辅助存储标记指定为新的主存储标记，使得目的地分区开始处理客户端请求，将结果事务发送到源分区，并提供对其的读取和写入访问 。 另一个迁移操作包括将主存储戳记指定为新的辅助存储戳，使得源分区开始重播事务。

公开(公告)号：US09098470B2

公开(公告)日：2015-08-04

申请号：US13113729

申请日：2011-05-23

申请人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Padmanabha Chakravarthy Uddaraju ,  Ju Wang ,  Hemal Khatri ,  Arild Skjolsvold ,  Harshawardhan Gadgil

发明人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Padmanabha Chakravarthy Uddaraju ,  Ju Wang ,  Hemal Khatri ,  Arild Skjolsvold ,  Harshawardhan Gadgil

IPC分类号： G06F7/00 ,  G06F17/00 ,  G06F11/20 ,  G06F17/30

CPC分类号： G06F17/30215 ,  G06F11/2094 ,  G06F17/30176 ,  G06F17/30575 ,  G06F17/30589

摘要： Presented herein are methods of replicating versioned and hierarchical data structures, as well as data structures representing complex transactions. Due to interdependencies between data entities and a lack of guaranteed message ordering, simple replication methods employed for simple data types cannot be used. Operations on data structures exhibit dependencies between the messages making up the operations. This strategy can be extended to various types of complex transactions by considering certain messages to depend on other messages or on the existence of other entries at the data store. Regardless of origin, these dependencies can be enforced by suspending the processing of messages with unsatisfied dependencies until all of its dependencies have been met. Alternately, transactions can be committed immediately, creating entities that include versioned identifiers for each of their dependencies. These entities can then be garbage collected of the parent objects are not subsequently created.

摘要翻译： 这里呈现的是复制版本化和分层数据结构以及表示复杂事务的数据结构的方法。 由于数据实体之间的相互依赖关系和缺乏有保证的消息排序，简单数据类型采用简单的复制方法是不可能的。 对数据结构的操作表现出构成操作的消息之间的依赖关系。 该策略可以通过考虑某些消息来依赖于其他消息或数据存储上的其他条目的存在来扩展到各种类型的复杂事务。 无论起源是什么，这些依赖关系可以通过暂停处理具有不满足依赖性的消息来实现，直到其所有依赖关系得到满足。 或者，可以立即提交事务，创建包含每个依赖关系的版本标识符的实体。 这些实体然后可以被垃圾收集的父对象不后来被创建。

公开(公告)号：US20120303578A1

公开(公告)日：2012-11-29

申请号：US13113729

申请日：2011-05-23

申请人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Padmanabha Chakravarthy Uddaraju ,  Ju Wang ,  Hemal Khatri ,  Arild Skjolsvold ,  Harshawardhan Gadgil

发明人： Bradley Gene Calder ,  Niranjan Nilakantan ,  Shashwat Srivastav ,  Jiesheng Wu ,  Abdul Rafay Abbasi ,  Shane Mainali ,  Padmanabha Chakravarthy Uddaraju ,  Ju Wang ,  Hemal Khatri ,  Arild Skjolsvold ,  Harshawardhan Gadgil

IPC分类号： G06F17/30 ,  G06F7/00

CPC分类号： G06F17/30215 ,  G06F11/2094 ,  G06F17/30176 ,  G06F17/30575 ,  G06F17/30589

摘要： Presented herein are methods of replicating versioned and hierarchical data structures, as well as data structures representing complex transactions. Due to interdependencies between data entities and a lack of guaranteed message ordering, simple replication methods employed for simple data types cannot be used. Operations on data structures exhibit dependencies between the messages making up the operations. This strategy can be extended to various types of complex transactions by considering certain messages to depend on other messages or on the existence of other entries at the data store. Regardless of origin, these dependencies can be enforced by suspending the processing of messages with unsatisfied dependencies until all of its dependencies have been met. Alternately, transactions can be committed immediately, creating entities that include versioned identifiers for each of their dependencies. These entities can then be garbage collected of the parent objects are not subsequently created.

摘要翻译： 这里呈现的是复制版本化和分层数据结构以及表示复杂事务的数据结构的方法。 由于数据实体之间的相互依赖关系和缺乏有保证的消息排序，简单数据类型采用简单的复制方法是不可能的。 对数据结构的操作表现出构成操作的消息之间的依赖关系。 该策略可以通过考虑某些消息来依赖于其他消息或数据存储上的其他条目的存在来扩展到各种类型的复杂事务。 无论起源是什么，这些依赖关系可以通过暂停处理具有不满足依赖性的消息来实现，直到其所有依赖关系得到满足。 或者，可以立即提交事务，创建包含每个依赖关系的版本标识符的实体。 这些实体然后可以被垃圾收集的父对象不后来被创建。

公开(公告)号：US09372735B2

公开(公告)日：2016-06-21

申请号：US13346348

申请日：2012-01-09

申请人： Bradley Gene Calder ,  Ju Wang ,  Vaman Bedekar ,  Sriram Sankaran ,  Marvin McNett, II ,  Pradeep Kumar Gunda ,  Yang Zhang ,  Shyam Antony ,  Kavitha Manivannan ,  Arild E Skjolsvold ,  Hemal Khatri

发明人： Bradley Gene Calder ,  Ju Wang ,  Vaman Bedekar ,  Sriram Sankaran ,  Marvin McNett, II ,  Pradeep Kumar Gunda ,  Yang Zhang ,  Shyam Antony ,  Kavitha Manivannan ,  Arild E Skjolsvold ,  Hemal Khatri

IPC分类号： G06F9/46 ,  G06F9/50

CPC分类号： G06F9/5077 ,  G06F9/46 ,  G06F9/50

摘要： In various embodiments, systems and methods are presented for providing resources by way of a platform as a service in a distributed computing environment to perform a job. The system may be comprised of a number of components, such as a task machine, a task location service machine, and a high-level location service machines that in combination are useable to accomplish functions provided herein. It is contemplated that the system performs methods for providing resources by determining resources of the system, such as virtual machines, and applying auto-scaling rules to the system to scale those resources. Based on the determination of the auto-scaling rules, the resources may be allocated to achieve a desired result.

摘要翻译： 在各种实施例中，提供了系统和方法，用于通过平台作为在分布式计算环境中的服务来提供资源以执行作业。 该系统可以由许多组件组成，诸如任务机器，任务定位服务机器和组合可用于完成本文提供的功能的高级位置服务机器。 可以预期的是，系统通过确定诸如虚拟机的系统的资源以及向系统应用自动缩放规则来扩展这些资源来执行用于提供资源的方法。 基于自动缩放规则的确定，可以分配资源以实现期望的结果。

公开(公告)号：US09170849B2

公开(公告)日：2015-10-27

申请号：US13346303

申请日：2012-01-09

申请人： Bradley Gene Calder ,  Ju Wang ,  Vaman Bedekar ,  Sriram Sankaran ,  Marvin McNett, II ,  Pradeep Kumar Gunda ,  Yang Zhang ,  Shyam Antony ,  Kavitha Manivannan ,  Arild E. Skjolsvold ,  Hemal Khatri

发明人： Bradley Gene Calder ,  Ju Wang ,  Vaman Bedekar ,  Sriram Sankaran ,  Marvin McNett, II ,  Pradeep Kumar Gunda ,  Yang Zhang ,  Shyam Antony ,  Kavitha Manivannan ,  Arild E. Skjolsvold ,  Hemal Khatri

IPC分类号： G06F9/455 ,  G06F9/50

CPC分类号： G06F9/5072 ,  G06F9/5088 ,  G06F2009/45575 ,  G06F2209/5011 ,  G06F2209/5022

摘要： Systems and methods are presented for providing resources by way of a platform as a service in a distributed computing environment to perform a job. Resources of the system, job performing on the system, and schedulers of the jobs performing on the system are decoupled in a manner that allows a job to easily migrate among resources. It is contemplated that the migration of jobs from a first pool of resource to a second pool of resource is performed by the system without human intervention. The migration of a job may utilize different schedulers for the different resources. Further, it is contemplated that a pool of resources may automatically allocate additional or fewer resources in response to a migration of a job.

摘要翻译： 呈现系统和方法，用于通过在分布式计算环境中的平台作为服务来提供资源以执行作业。 系统的资源，在系统上执行的作业以及在系统上执行的作业的调度程序以允许作业容易地在资源之间迁移的方式去耦。 预期作业从第一资源池迁移到第二资源池是由系统执行而无需人为干预的。 作业的迁移可以针对不同的资源利用不同的调度器。 此外，预期资源池可以响应于作业的迁移而自动分配额外的或较少的资源。