-
公开(公告)号:US20110131579A1
公开(公告)日:2011-06-02
申请号:US12841961
申请日:2010-07-22
申请人: TETSUFUMI TSUKAMOTO , Hideyuki Kato , Hideki Ishiai , Yuki Tateishi , Takahiro Kyuma , Yozo Ito , Takeshi Fujisawa , Masaaki Hosouchi , Kazuhiko Watanabe
发明人: TETSUFUMI TSUKAMOTO , Hideyuki Kato , Hideki Ishiai , Yuki Tateishi , Takahiro Kyuma , Yozo Ito , Takeshi Fujisawa , Masaaki Hosouchi , Kazuhiko Watanabe
IPC分类号: G06F9/46
CPC分类号: G06F9/5027 , G06F2209/5017 , G06Q40/04
摘要: A batch job multiplex processing method which solves the problem that a system which performs multiplex processing including parallel processing on plural nodes cannot cope with a sudden increase in the volume of data to be batch-processed using a predetermined value of multiplicity, for example, in securities trading in which the number of transactions may suddenly increase on a particular day. The method dynamically determines the value of multiplicity of processing including parallel processing in execution of a batch job on plural nodes. More specifically, in the method, multiplicity is determined depending on the node status (node performance and workload) and the status of an input file for the batch job.
摘要翻译: 一种批量作业多路复用处理方法,其解决了包括在多个节点上并行处理的执行多路复用处理的系统不能使用预定的多重值来处理待批量处理的数据量的突然增加的问题,例如, 交易数量可能在特定日子突然增加的证券交易。 该方法动态地确定包括在多个节点上执行批处理作业的并行处理的多重处理的值。 更具体地,在该方法中,根据节点状态(节点性能和工作负载)以及批处理作业的输入文件的状态来确定多重性。
-
公开(公告)号:US20120210323A1
公开(公告)日:2012-08-16
申请号:US13388546
申请日:2010-03-12
IPC分类号: G06F9/46
CPC分类号: G06F9/485 , G06F9/5038
摘要: A rerunning load is reduced for reducing the risk of exceeding a specified termination time after abnormally ending a job net. Even if the same data processed by jobs within a job net is replaced with split data of sub-jobs and some of sub-jobs have been abnormally ended, the job net is continued. For each split data, a state and/or an execution server ID of each job are stored, and the progress of a job net is managed. Only split data whose state is not “normal” is to be processed by rerunning. Based on states of execution servers, on whether or not intermediate files transferred between jobs is shared among execution servers, and on whether or not an output file is deleted after ending the subsequent job, it is judged whether or not intermediate files can be referred to and from what job the rerun is to be performed.
摘要翻译: 降低重新运行负载,以减少异常结束工作网后超出指定终止时间的风险。 即使由作业网中的作业处理的相同数据被替换为子作业的分割数据,并且一些子作业异常结束,则工作网继续进行。 对于每个分割数据,存储每个作业的状态和/或执行服务器ID,并且管理作业网的进度。 只有状态不是“正常”的分割数据才能通过重新运行来处理。 基于执行服务器的状态,关于作业之间传送的中间文件是否在执行服务器之间共享,以及在结束后续作业之后是否删除输出文件,判断是否可以引用中间文件 以及从什么工作重新执行。
-