Adaptive task scheduling of Hadoop in a virtualized environment
    1.
    发明授权
    Adaptive task scheduling of Hadoop in a virtualized environment 有权
    Hadoop在虚拟化环境中的自适应任务调度

    公开(公告)号:US09183016B2

    公开(公告)日:2015-11-10

    申请号:US13778441

    申请日:2013-02-27

    Applicant: VMware, Inc.

    Abstract: A control module is introduced to communicate with an application workload scheduler of a distributed computing application, such as a Job Tracker node of a Hadoop cluster, and with the virtualized computing environment underlying the application. The control module periodically queries for resource consumption data, such as CPU utilization, and uses the data to calculate how MapReduce task slots should be allocated on each task node of the Hadoop cluster. The control module passes the task slot allocation to the application workload scheduler, which honors the allocation by adjusting task assignments to task nodes accordingly. The task nodes may also activate and deactivate task slots according to the changed slot allocation. As a result, the distributed computing application is able to scale up and down when other workloads sharing the virtualized computing environment change.

    Abstract translation: 引入控制模块以与分布式计算应用的应用工作负载调度器(例如Hadoop集群的作业跟踪器节点)以及应用程序的虚拟化计算环境进行通信。 控制模块定期查询资源消耗数据(如CPU利用率),并使用该数据计算如何在Hadoop集群的每个任务节点上分配MapReduce任务槽。 控制模块将任务时隙分配传递给应用程序工作负载调度程序,通过相应地调整任务分配来赋予分配权限。 任务节点还可以根据改变的时隙分配激活和去激活任务时隙。 因此,分布式计算应用程序能够在共享虚拟化计算环境的其他工作负载发生变化时上下放大。

    Storage of key-value entries in a distributed storage system

    公开(公告)号:US11256717B2

    公开(公告)日:2022-02-22

    申请号:US16658172

    申请日:2019-10-21

    Applicant: VMware, Inc.

    Abstract: A distributed storage system, such as a distributed storage system in a virtualized computing environment, stores data in storage nodes as immutable key-value entries. A coordinator storage node creates a key-value entry and attempts to store the key-value entry in the coordinator storage node and in neighbor storage nodes. If the storage of the key-value entry in the in the coordinator storage node and in the neighbor storage node is successful, the coordinator storage node pushes the key-value entry to other storage nodes in the distributed storage system for storage as replicas.

Patent Agency Ranking