公开(公告)号：US20180144025A1

公开(公告)日：2018-05-24

申请号：US15875518

申请日：2018-01-19

Applicant: Red Hat, Inc.

Inventor： Shaun David Appleton

IPC: G06F17/30 ,  G06F9/46

CPC classification number: G06F16/245 ,  G06F9/46 ,  G06F9/5066 ,  G06F16/27 ,  G06F16/285

Abstract: A method and system is disclosed that identifies a job written in a first language. The job is to be performed in parallel on a plurality of nodes of a plurality of clusters. The first language describes functions supported by multiple frameworks but is not specific to any of the multiple frameworks. The method and system select one or more clusters from the plurality of clusters to run the job. The selected one or more clusters of the plurality of clusters operate a different framework from other clusters of the plurality of clusters. The method and system identify a second language associated with the selected one or more clusters. The method and system convert the first language of the job into the second language and cause the job in the second language to be run on the plurality of nodes of the selected one or more clusters.

公开(公告)号：US09910888B2

公开(公告)日：2018-03-06

申请号：US14504237

申请日：2014-10-01

Applicant: Red Hat, Inc.

Inventor： Shaun David Appleton

IPC: G06F7/04 ,  G06F17/30 ,  G06F9/46

CPC classification number: G06F17/30424 ,  G06F9/46 ,  G06F17/30283 ,  G06F17/30575 ,  G06F17/30598

Abstract: A method for map-reduce job virtualization is disclosed. The method includes receiving a map-reduce job written in a first map-reduce language. The map-reduce job is to be performed in parallel on a plurality of nodes of a plurality of clusters. The method also includes selecting one or more clusters to run the map-reduce job. The method further includes identifying a second map-reduce language associated with the selected clusters. The method also includes converting the first map-reduce language of the map-reduce job into the second map-reduce language. The method further causes the map-reduce job in the second map-reduce language to be run on the plurality of nodes of the selected clusters.

公开(公告)号：US20160098472A1

公开(公告)日：2016-04-07

申请号：US14504237

申请日：2014-10-01

Applicant: Red Hat, Inc.

Inventor： Shaun David Appleton

IPC: G06F17/30

CPC classification number: G06F17/30424 ,  G06F9/46 ,  G06F17/30283 ,  G06F17/30575 ,  G06F17/30598

Abstract: A method for map-reduce job virtualization is disclosed. The method includes receiving a map-reduce job written in a first map-reduce language. The map-reduce job is to be performed in parallel on a plurality of nodes of a plurality of clusters. The method also includes selecting one or more clusters to run the map-reduce job. The method further includes identifying a second map-reduce language associated with the selected clusters. The method also includes converting the first map-reduce language of the map-reduce job into the second map-reduce language. The method further causes the map-reduce job in the second map-reduce language to be run on the plurality of nodes of the selected clusters.

Abstract translation: 公开了一种减少作业虚拟化的方法。 该方法包括接收以第一映射减少语言编写的地图缩减作业。 映射减少作业将在多个簇的多个节点上并行执行。 该方法还包括选择一个或多个群集以运行map-reduce作业。 该方法还包括识别与所选择的群集相关联的第二地图降低语言。 该方法还包括将map-reduce作业的第一map-reduce语言转换成第二map-reduce语言。 该方法还使得第二映射减少语言中的映射减少作业在所选择的簇的多个节点上运行。