发明授权
- 专利标题: Transparent efficiency for in-memory execution of map reduce job sequences
- 专利标题(中): 内存执行的透明效率降低了作业序列
-
申请号: US13594788申请日: 2012-08-25
-
公开(公告)号: US09147373B2公开(公告)日: 2015-09-29
- 发明人: David Cunningham , Benjamin W. Herta , Vijay A. Saraswat , Avraham E. Shinnar
- 申请人: David Cunningham , Benjamin W. Herta , Vijay A. Saraswat , Avraham E. Shinnar
- 申请人地址: US NY Armonk
- 专利权人: International Business Machines Corporation
- 当前专利权人: International Business Machines Corporation
- 当前专利权人地址: US NY Armonk
- 代理机构: Scully, Scott, Murphy & Presser, P.C.
- 代理商 Preston Young, Esq.
- 主分类号: G06F9/46
- IPC分类号: G06F9/46 ; G06F15/00 ; G09G5/00 ; G06F17/30
摘要:
Executing a map reduce sequence may comprise executing all jobs in the sequence by a collection of a plurality of processes with each process running one or more mappers, combiners, partitioners and reducers for each job, and transparently sharing heap state between the jobs to improve metrics associated with the job. Processes may communicate among themselves to coordinate completion of map, shuffle and reduce phases, and completion of said all jobs in the sequence.
公开/授权文献
信息查询