Optimized resource management for map/reduce computing
    21.
    发明授权
    Optimized resource management for map/reduce computing 有权
    优化资源管理,用于地图/减少计算

    公开(公告)号:US09323580B2

    公开(公告)日:2016-04-26

    申请号:US13406873

    申请日:2012-02-28

    IPC分类号: G06F15/173 G06F9/50 H04L12/24

    摘要: The present invention includes a method for resource optimization of map/reduce computing in a computing cluster. The method can include receiving a computational problem for processing in a map/reduce module, subdividing the computational problem into a set of sub-problems and mapping a selection of the sub-problems in the set to respective nodes in a computing cluster, for example a cloud computing cluster, computing for a subset of the nodes in the computing cluster a required resource capacity of the subset of the nodes to process a mapped one of the sub-problems and an existing capacity of the subset of the nodes, and augmenting the existing capacity to an augmented capacity when the required resource capacity exceeds the existing capacity, and when a cost of augmenting the existing capacity to the augmented capacity does not exceed a penalty for breaching a service level agreement (SLA) for the subset of the nodes.

    摘要翻译: 本发明包括用于计算集群中的映射/减少计算的资源优化的方法。 该方法可以包括在地图/缩小模块中接收用于处理的计算问题,将计算问题细分为一组子问题,并将集合中的子问题的选择映射到计算集群中的相应节点,例如 云计算集群,计算群集中节点子集的一部分,节点子集的所需资源容量,以处理映射的一个子问题和节点子集的现有容量,并增加 当所需资源容量超过现有容量时,增加容量的现有容量,以及当增加容量的现有容量的成本不超过违反节点子集的服务级别协议(SLA)的惩罚。

    Automated cloud workload management in a map-reduce environment
    22.
    发明授权
    Automated cloud workload management in a map-reduce environment 有权
    在减少地图的环境中自动化云工作负载管理

    公开(公告)号:US09141433B2

    公开(公告)日:2015-09-22

    申请号:US12642659

    申请日:2009-12-18

    IPC分类号: G06F9/46 G06F9/50

    摘要: A computing device associated with a cloud computing environment identifies a first worker cloud computing device from a group of worker cloud computing devices with available resources sufficient to meet required resources for a highest-priority task associated with a computing job including a group of prioritized tasks. A determination is made as to whether an ownership conflict would result from an assignment of the highest-priority task to the first worker cloud computing device based upon ownership information associated with the computing job and ownership information associated with at least one other task assigned to the first worker cloud computing device. The highest-priority task is assigned to the first worker cloud computing device in response to determining that the ownership conflict would not result from the assignment of the highest-priority task to the first worker cloud computing device.

    摘要翻译: 与云计算环境相关联的计算设备使用足够的资源来满足来自一组工作者云计算设备的第一工作者云计算设备,以满足与包括一组优先化任务的计算作业相关联的最高优先级任务所需的资源。 确定基于与计算作业相关联的所有权信息和与分配给第一工作者云计算设备的至少一个其他任务相关联的所有权信息将最高优先级任务分配给第一工作者云计算设备是否产生所有权冲突 第一个工作者云计算设备。 响应于确定所述权限冲突不会由最高优先级任务分配给第一工作者云计算设备而将最高优先级任务分配给第一工作者云计算设备。

    Network-aware structured content downloads
    23.
    发明授权
    Network-aware structured content downloads 有权
    网络感知结构化内容下载

    公开(公告)号:US08930448B2

    公开(公告)日:2015-01-06

    申请号:US13435091

    申请日:2012-03-30

    摘要: A request for content is received at a content server via a first network connection from a client device. The content includes a set of portions represented within a root document. Based upon a download constraint of at least one portion of the content and a network characteristic of the first network connection, at least one portion of the content is deferred for download over a network connection other than the first network connection. The content is sent with each deferred portion of the content replaced with a content stub within the root document. Each content stub identifies the respective portion of the content as a deferred portion of the content and includes a content identifier of the respective deferred portion of the content.

    摘要翻译: 通过来自客户端设备的第一网络连接在内容服务器处接收对内容的请求。 内容包括在根文档内表示的一组部分。 基于内容的至少一部分的下载约束和第一网络连接的网络特性,内容的至少一部分被推迟通过除了第一网络连接之外的网络连接进行下载。 发送内容,每个延迟部分的内容替换为根文档内的内容存根。 每个内容存根将内容的相应部分标识为内容的延迟部分,并且包括内容的相应延迟部分的内容标识符。

    Holistic task scheduling for distributed computing
    24.
    发明授权
    Holistic task scheduling for distributed computing 有权
    分布式计算的整体任务调度

    公开(公告)号:US08595735B2

    公开(公告)日:2013-11-26

    申请号:US13407669

    申请日:2012-02-28

    IPC分类号: G06F9/46 G06F15/173

    CPC分类号: G06F9/4881

    摘要: Embodiments of the present invention provide a method for holistic task scheduling in a distributed computing environment. In an embodiment of the invention, a method for holistic task scheduling in a distributed computing environment is provided. The method includes selecting a first task for a first job and a second task for a different, second job, both jobs being scheduled for processing within a node of a distributed computing environment by a task scheduler executing in memory by at least one processor of a computer. The method also can include comparing an estimated time to complete the first and second jobs. Finally, the first task can be scheduled for processing in the node when the estimated time to complete the second job exceeds the estimated time to complete the first job. Otherwise the second task can be scheduled for processing in the node when the estimated time to complete the first job exceeds the estimated time to complete the second job.

    摘要翻译: 本发明的实施例提供了一种用于分布式计算环境中的整体任务调度的方法。 在本发明的实施例中,提供了一种用于分布式计算环境中的整体任务调度的方法。 该方法包括为不同的第二作业选择用于第一作业的第一任务和第二任务,两个作业被调度用于在由分布式计算环境的节点内处理的任务调度器中,所述任务调度器由存储器中的至少一个处理器 电脑。 该方法还可以包括比较估计的时间以完成第一和第二作业。 最后,当完成第二个工作的预计时间超过完成第一个作业的预计时间时,可以安排第一个任务在节点中进行处理。 否则,当完成第一个作业的估计时间超过完成第二个作业的估计时间时,可以将第二个任务安排在节点中进行处理。

    HOLISTIC TASK SCHEDULING FOR DISTRIBUTED COMPUTING
    25.
    发明申请
    HOLISTIC TASK SCHEDULING FOR DISTRIBUTED COMPUTING 有权
    用于分布式计算的HOSISTIC任务调度

    公开(公告)号:US20120216203A1

    公开(公告)日:2012-08-23

    申请号:US13407669

    申请日:2012-02-28

    IPC分类号: G06F9/46

    CPC分类号: G06F9/4881

    摘要: Embodiments of the present invention provide a method, system and computer program product for holistic task scheduling in a distributed computing environment. In an embodiment of the invention, a method for holistic task scheduling in a distributed computing environment is provided. The method includes selecting a first task for a first job and a second task for a different, second job, both jobs being scheduled for processing within a node a distributed computing environment by a task scheduler executing in memory by at least one processor of a computer.

    摘要翻译: 本发明的实施例提供了一种用于分布式计算环境中的整体任务调度的方法,系统和计算机程序产品。 在本发明的实施例中,提供了一种用于分布式计算环境中的整体任务调度的方法。 该方法包括为不同的第二作业选择用于第一作业的第一任务和第二任务,两个作业被调度用于由计算机中的至少一个处理器在存储器中执行的任务调度器在分布式计算环境内处理节点 。

    AUTOMATED CLOUD WORKLOAD MANAGEMENT IN A MAP-REDUCE ENVIRONMENT
    26.
    发明申请
    AUTOMATED CLOUD WORKLOAD MANAGEMENT IN A MAP-REDUCE ENVIRONMENT 有权
    自动化云在地图减少环境中的工作流程管理

    公开(公告)号:US20120192197A1

    公开(公告)日:2012-07-26

    申请号:US13434768

    申请日:2012-03-29

    IPC分类号: G06F9/50 G06F15/16

    摘要: A computing device associated with a cloud computing environment identifies a first worker cloud computing device from a group of worker cloud computing devices with available resources sufficient to meet required resources for a highest-priority task associated with a computing job including a group of prioritized tasks. A determination is made as to whether an ownership conflict would result from an assignment of the highest-priority task to the first worker cloud computing device based upon ownership information associated with the computing job and ownership information associated with at least one other task assigned to the first worker cloud computing device. The highest-priority task is assigned to the first worker cloud computing device in response to determining that the ownership conflict would not result from the assignment of the highest-priority task to the first worker cloud computing device.

    摘要翻译: 与云计算环境相关联的计算设备使用足够的资源来满足来自一组工作者云计算设备的第一工作者云计算设备,以满足与包括一组优先化任务的计算作业相关联的最高优先级任务所需的资源。 确定基于与计算作业相关联的所有权信息和与分配给第一工作者云计算设备的至少一个其他任务相关联的所有权信息将最高优先级任务分配给第一工作者云计算设备是否产生所有权冲突 第一个工作者云计算设备。 响应于确定所述权限冲突不会由最高优先级任务分配给第一工作者云计算设备而将最高优先级任务分配给第一工作者云计算设备。

    HOLISTIC TASK SCHEDULING FOR DISTRIBUTED COMPUTING
    27.
    发明申请
    HOLISTIC TASK SCHEDULING FOR DISTRIBUTED COMPUTING 审中-公开
    用于分布式计算的HOSISTIC任务调度

    公开(公告)号:US20120005682A1

    公开(公告)日:2012-01-05

    申请号:US12828281

    申请日:2010-06-30

    IPC分类号: G06F9/46

    CPC分类号: G06F9/4881

    摘要: Embodiments of the present invention provide a method, system and computer program product for holistic task scheduling in a distributed computing environment. In an embodiment of the invention, a method for holistic task scheduling in a distributed computing environment is provided. The method includes selecting a first task for a first job and a second task for a different, second job, both jobs being scheduled for processing within a node a distributed computing environment by a task scheduler executing in memory by at least one processor of a computer. The method also can include comparing an estimated time to complete the first and second jobs. Finally, the first task can be scheduled for processing in the node when the estimated time to complete the second job exceeds the estimated time to complete the first job. Otherwise the second task can be scheduled for processing in the node when the estimated time to complete the first job exceeds the estimated time to complete the second job.

    摘要翻译: 本发明的实施例提供了一种用于分布式计算环境中的整体任务调度的方法,系统和计算机程序产品。 在本发明的实施例中,提供了一种用于分布式计算环境中的整体任务调度的方法。 该方法包括为不同的第二作业选择用于第一作业的第一任务和第二任务,两个作业被调度用于由计算机中的至少一个处理器在存储器中执行的任务调度器在分布式计算环境内处理节点 。 该方法还可以包括比较估计的时间以完成第一和第二作业。 最后,当完成第二个工作的预计时间超过完成第一个作业的预计时间时,可以安排第一个任务在节点中进行处理。 否则,当完成第一个作业的估计时间超过完成第二个作业的估计时间时,可以将第二个任务安排在节点中进行处理。

    Flexible system and method for mirroring data
    29.
    发明授权
    Flexible system and method for mirroring data 有权
    灵活的数据镜像系统和方法

    公开(公告)号:US07191298B2

    公开(公告)日:2007-03-13

    申请号:US10211686

    申请日:2002-08-02

    IPC分类号: G06F12/00

    摘要: A flexible data mirroring system and method are adapted for use in a data processing system having first and second data storage devices. Upon receiving notification of a file update to be written to the first data storage device a mirror mode and mirror event associated with the updated file are determined from mirror information that has been provisioned on a per-file, per-directory or per-volume, etc. basis. The file update is mirrored to the second data storage device according to the provisioned mirror mode and mirror event. If the mirror mode is continuous, the mirror operation proceeds immediately. If the mirror mode is discrete, the file update is noted and the mirror operation proceeds following occurrence of the file's mirror event.

    摘要翻译: 灵活的数据镜像系统和方法适用于具有第一和第二数据存储设备的数据处理系统。 在接收到要写入到第一数据存储设备的文件更新的通知时,根据已经在每个文件,每个目录或每个卷上提供的镜像信息来确定与更新的文件相关联的镜像模式和镜像事件, 等等。 根据配置的镜像模式和镜像事件,将文件更新镜像到第二个数据存储设备。 如果镜像模式是连续的,镜像操作立即进行。 如果镜像模式是离散的,则会记录文件更新,镜像操作在文件的镜像事件发生后继续进行。

    Automated cloud workload management in a map-reduce environment
    30.
    发明授权
    Automated cloud workload management in a map-reduce environment 有权
    在减少地图的环境中自动化云工作负载管理

    公开(公告)号:US08839260B2

    公开(公告)日:2014-09-16

    申请号:US13434768

    申请日:2012-03-29

    IPC分类号: G06F9/46

    摘要: A computing device associated with a cloud computing environment identifies a first worker cloud computing device from a group of worker cloud computing devices with available resources sufficient to meet required resources for a highest-priority task associated with a computing job including a group of prioritized tasks. A determination is made as to whether an ownership conflict would result from an assignment of the highest-priority task to the first worker cloud computing device based upon ownership information associated with the computing job and ownership information associated with at least one other task assigned to the first worker cloud computing device. The highest-priority task is assigned to the first worker cloud computing device in response to determining that the ownership conflict would not result from the assignment of the highest-priority task to the first worker cloud computing device.

    摘要翻译: 与云计算环境相关联的计算设备使用足够的资源来满足来自一组工作者云计算设备的第一工作者云计算设备,以满足与包括一组优先化任务的计算作业相关联的最高优先级任务所需的资源。 确定基于与计算作业相关联的所有权信息和与分配给第一工作者云计算设备的至少一个其他任务相关联的所有权信息将最高优先级任务分配给第一工作者云计算设备是否产生所有权冲突 第一个工作者云计算设备。 响应于确定所述权限冲突不会由最高优先级任务分配给第一工作者云计算设备而将最高优先级任务分配给第一工作者云计算设备。