Database query optimizer that takes network choice into consideration

    公开(公告)号:US10452654B2

    公开(公告)日:2019-10-22

    申请号:US13769734

    申请日:2013-02-18

    IPC分类号: G06F16/2453 G06F16/2458

    摘要: In a networked computer system that includes multiple nodes and multiple networks interconnecting the nodes, a database query optimizer takes network choice into consideration when optimizing a query. The query optimizer logs historical information for queries that includes network information. A network monitor determines network characteristics of the multiple networks. The query optimizer then selects a network for a query based on the network characteristics, and optionally based on the historical information as well. The result is a query optimizer that takes network choice into consideration, thereby providing a query that is optimized according to the characteristics of the networks.

    Environment based node selection for work scheduling in a parallel computing system
    15.
    发明授权
    Environment based node selection for work scheduling in a parallel computing system 有权
    基于环境的节点选择在并行计算系统中的工作调度

    公开(公告)号:US09122525B2

    公开(公告)日:2015-09-01

    申请号:US14067694

    申请日:2013-10-30

    IPC分类号: G06F9/48 G06F9/50 G06F1/32

    摘要: A method, apparatus, and program product manage scheduling of a plurality of jobs in a parallel computing system of the type that includes a plurality of computing nodes and is disposed in a data center. The plurality of jobs are scheduled for execution on a group of computing nodes from the plurality of computing nodes based on the physical locations of the plurality of computing nodes in the data center. The group of computing nodes is further selected so as to distribute at least one of a heat load and an energy load within the data center. The plurality of jobs may be additionally scheduled based upon an estimated processing requirement for each job of the plurality of jobs.

    摘要翻译: 一种方法,装置和程序产品管理包括多个计算节点并且被布置在数据中心中的并行计算系统中的多个作业的调度。 多个作业被调度为基于数据中心中的多个计算节点的物理位置从多个计算节点在一组计算节点上执行。 进一步选择计算节点组,以便分配数据中心内的热负荷和能量负载中的至少一个。 可以基于对多个作业的每个作业的估计的处理要求来另外地调度多个作业。

    Optimized peer-to-peer file transfers on a multi-node computer system
    16.
    发明授权
    Optimized peer-to-peer file transfers on a multi-node computer system 有权
    在多节点计算机系统上优化对等文件传输

    公开(公告)号:US08856275B2

    公开(公告)日:2014-10-07

    申请号:US13787728

    申请日:2013-03-06

    摘要: A method and apparatus performs peer-to-peer file transfers on a High Performance Computing (HPC) cluster such as a Beowulf cluster. A peer-to-peer file tracker (PPFT) allows operating system, application and data files to be moved from a pre-loaded node to another node of the HPC cluster. A peer-to-peer (PTP) client is loaded into the nodes to facilitate PTP file transfers to reduce loading on networks, network switches and file servers to reduce the time needed to load the nodes with these files to increase overall efficiency of the multi-node computing system. The selection of the nodes participating in file transfers can be based on network topology, network utilization, job status and predicted network/computer utilization. This selection can be dynamic, changing during the file transfers as resource conditions change. The policies used to choose resources can be configured by an administrator.

    摘要翻译: 一种方法和装置在诸如Beowulf集群的高性能计算(HPC)集群上执行对等文件传输。 点对点文件跟踪器(PPFT)允许操作系统,应用程序和数据文件从预加载节点移动到HPC群集的另一个节点。 将点对点(PTP)客户端加载到节点中以便于PTP文件传输以减少网络,网络交换机和文件服务器上的负载,从而减少使用这些文件加载​​节点所需的时间,从而提高整体效率 节点计算系统 参与文件传输的节点选择可以基于网络拓扑,网络利用率,作业状态和预测的网络/计算机利用率。 此选择可以是动态的,在资源条件改变时在文件传输期间更改。 用于选择资源的策略可以由管理员进行配置。

    Query execution and optimization with autonomic error recovery from network failures in a parallel computer system with multiple networks
    17.
    发明授权
    Query execution and optimization with autonomic error recovery from network failures in a parallel computer system with multiple networks 失效
    在具有多个网络的并行计算机系统中的网络故障自动错误恢复的查询执行和优化

    公开(公告)号:US08788660B2

    公开(公告)日:2014-07-22

    申请号:US13786430

    申请日:2013-03-05

    IPC分类号: G06F11/20

    摘要: A database query execution monitor determines if a network error or low performance condition exists and then where possible modifies the query. The query execution monitor then determines an alternate query execution plan to continue execution of the query. The query optimizer can re-optimize the query to use a different network or node. Thus, the query execution monitor allows autonomic error recovery for network failures using an alternate query execution. The alternate query execution could also be determined at the initial optimization time and then this alternate plan used to execute a query in the case of a particular network failure.

    摘要翻译: 数据库查询执行监视器确定是否存在网络错误或低性能条件,然后在可能的情况下修改查询。 然后,查询执行监视器确定备用查询执行计划以继续执行查询。 查询优化器可以重新优化查询以使用不同的网络或节点。 因此,查询执行监视器允许使用备用查询执行的网络故障的自主错误恢复。 还可以在初始优化时间确定备用查询执行,然后在特定网络故障的情况下用于执行查询的该备用计划。

    Optimizing power consumption and performance in a hybrid computer environment
    19.
    发明授权
    Optimizing power consumption and performance in a hybrid computer environment 失效
    优化混合计算机环境中的功耗和性能

    公开(公告)号:US08677161B2

    公开(公告)日:2014-03-18

    申请号:US13771068

    申请日:2013-02-19

    IPC分类号: G06F1/00

    摘要: A method for optimizing efficiency and power consumption in a hybrid computer system is disclosed. The hybrid computer system may comprise one or more front-end nodes connected to a multi-node computer system. Portions of an application may be offloaded from the front-end nodes to the multi-node computer system. By building historical profiles of the applications running on the multi-node computer system, the system can analyze the trade offs between power consumption and performance. For example, if running the application on the multi-node computer system cuts the run time by 5% but increases power consumption by 20% it may be more advantageous to simply run the entire application on the front-end.

    摘要翻译: 公开了一种用于优化混合计算机系统中的效率和功耗的方法。 混合计算机系统可以包括连接到多节点计算机系统的一个或多个前端节点。 应用程序的一部分可以从前端节点卸载到多节点计算机系统。 通过构建在多节点计算机系统上运行的应用程序的历史配置文件,系统可以分析功耗和性能之间的折衷。 例如,如果在多节点计算机系统上运行应用程序将运行时间缩短了5%,但是将功耗降低了20%,那么在前端简单地运行整个应用程序可能更有利。

    OPTIMIZED PEER-TO-PEER FILE TRANSFERS ON A MULTI-NODE COMPUTER SYSTEM

    公开(公告)号:US20130191504A1

    公开(公告)日:2013-07-25

    申请号:US13787728

    申请日:2013-03-06

    IPC分类号: H04L29/08

    摘要: A method and apparatus performs peer-to-peer file transfers on a High Performance Computing (HPC) cluster such as a Beowulf cluster. A peer-to-peer file tracker (PPFT) allows operating system, application and data files to be moved from a pre-loaded node to another node of the HPC cluster. A peer-to-peer (PTP) client is loaded into the nodes to facilitate PTP file transfers to reduce loading on networks, network switches and file servers to reduce the time needed to load the nodes with these files to increase overall efficiency of the multi-node computing system. The selection of the nodes participating in file transfers can be based on network topology, network utilization, job status and predicted network/computer utilization. This selection can be dynamic, changing during the file transfers as resource conditions change. The policies used to choose resources can be configured by an administrator.