公开(公告)号：US20150178419A1

公开(公告)日：2015-06-25

申请号：US14135114

申请日：2013-12-19

Applicant: Xerox Corporation

Inventor： JACK YANXIN LI ,  Gueyoung Jung

IPC: G06F17/50

CPC classification number: G06F9/5066 ,  G06F2209/5013

Abstract: A method, non-transitory computer readable medium, and apparatus for estimating a completion time for a MapReduce job are disclosed. For example, the method builds a general MapReduce performance model, computes one or more performance characteristics of each one of one or more benchmark workloads, computes one or more performance characteristics of the MapReduce job in the known processing system, selects a subset of the one or more benchmark workloads that have similar performance characteristics as the one or more performance characteristics of the MapReduce job, targets a cluster of processing nodes in a distributed processing system, computes one or more performance characteristics of the subset of the one or more benchmark workloads in the cluster of processing nodes and estimates the completion time for the MapReduce job.

Abstract translation: 公开了一种用于估计MapReduce作业的完成时间的方法，非暂时计算机可读介质和装置。 例如，该方法构建一个通用的MapReduce性能模型，计算一个或多个基准工作负载中的每一个的一个或多个性能特征，计算已知处理系统中MapReduce作业的一个或多个性能特征，选择一个 或具有与MapReduce作业的一个或多个性能特征相似的性能特征的更多基准工作负载，指定分布式处理系统中的一组处理节点，计算一个或多个基准工作负载子集的一个或多个性能特征 处理节点的集群，并估计MapReduce作业的完成时间。