发明授权
- 专利标题: Method and apparatus for configuring relevant parameters of MapReduce applications
-
申请号: US14813467申请日: 2015-07-30
-
公开(公告)号: US10831716B2公开(公告)日: 2020-11-10
- 发明人: Jie Liu , Ju Wei Shi , Chen Wang , Yong Zheng , Jia Zou
- 申请人: INTERNATIONAL BUSINESS MACHINES CORPORATION
- 申请人地址: US NY Armonk
- 专利权人: INTERNATIONAL BUSINESS MACHINES CORPORATION
- 当前专利权人: INTERNATIONAL BUSINESS MACHINES CORPORATION
- 当前专利权人地址: US NY Armonk
- 代理机构: Cantor Colburn LLP
- 代理商 Joseph Petrokaitis
- 优先权: com.zzzhc.datahub.patent.etl.us.BibliographicData$PriorityClaim@1a302cc7
- 主分类号: G06F16/182
- IPC分类号: G06F16/182
摘要:
Method and apparatus for configuring relevant parameters of MapReduce applications. The method includes: receiving a request for processing a first MapReduce job; obtaining job feature attributes of historical MapReduce jobs; searching out a job feature attribute of a second MapReduce job associated with the first MapReduce job from within the job feature attributes of the historical MapReduce jobs; configuring relevant parameters of the first MapReduce job based on the job feature attribute of the second MapReduce job. According to this method of configuring parameters, network overheads of file transfer can be effectively reduced, the method of configuring parameters of the MapReduce job can be processed locally as much as possible, thereby effectively increasing system resource utilization while reducing the administrator's configuration burden. An apparatus for configuring relevant parameters of MapReduce application is also provided.
公开/授权文献
信息查询