Dynamic Data Partitioning For Optimal Resource Utilization In A Parallel Data Processing System
    4.
    发明申请
    Dynamic Data Partitioning For Optimal Resource Utilization In A Parallel Data Processing System 有权
    并行数据处理系统中动态数据分区的优化资源利用

    公开(公告)号:US20120278586A1

    公开(公告)日:2012-11-01

    申请号:US13094074

    申请日:2011-04-26

    IPC分类号: G06F12/02

    CPC分类号: G06F9/505

    摘要: A method, computer program product, and system for dynamically distributing data for parallel processing in a computing system, comprising allocating a data buffer to each of a plurality of data partitions, where each data buffer stores data to be processed by its corresponding data partition, distributing data in multiple rounds to the data buffers for processing by the data partitions, where in each round the data is distributed based on a determined data processing capacity for each data partition, and where a greater amount of data is distributed to the data partitions with higher determined processing capacities, and periodically monitoring usage of each data buffer and re-determining the determined data processing capacity of each data partition based on its corresponding data buffer usage.

    摘要翻译: 一种用于在计算系统中动态地分发用于并行处理的数据的方法,计算机程序产品和系统,包括:将数据缓冲器分配给多个数据分区中的每一个,其中每个数据缓冲器存储要由其对应的数据分区处理的数据, 将数据以多轮数据分发到数据缓冲区以供数据分区处理,其中在每一轮中基于每个数据分区的确定的数据处理能力来分发数据,并且其中更大量的数据被分配给数据分区, 更高的确定的处理能力,并且周期性地监视每个数据缓冲器的使用,并且基于其相应的数据缓冲器使用重新确定每个数据分区的确定的数据处理能力。