公开(公告)号：US20150379022A1

公开(公告)日：2015-12-31

申请号：US14317687

申请日：2014-06-27

Applicant: General Electric Company

Inventor： Ernest Charles Puig ,  John A. Interrante ,  Mark David Osborn ,  Eric Pool

IPC: G06F17/30

CPC classification number: G06F16/116 ,  G06F9/5066 ,  G06F16/285

Abstract: Embodiments of the disclosure can include MapReduce systems and methods with integral mapper and reducer compute runtime environments. An example system with an integral reducer compute runtime environment can include mappers and reducers executable on a computer cluster. The mappers can be operable to receive raw input data and generate first input data based on the raw input data. The mappers can be operable to generate first result data based on the first input data. Based on the first result data, the mappers can be operable to generate (K, V) pairs. The reducers can be operable to receive the (K, V) pairs and generate second input data based on the (K, V) pairs. The reducers can be operable to transmit the second input data to integral compute runtime environment being run within the reducers and operable to generate second result data based on the second input data. Based on the second result data, the reducers can be operable to generate output data.

Abstract translation: 本公开的实施例可以包括MapReduce系统和具有集成映射器和还原器计算运行时环境的方法。 具有集成reducer计算运行时环境的示例系统可以包括在计算机集群上可执行的映射器和还原器。 映射器可以用于接收原始输入数据并且基于原始输入数据生成第一输入数据。 映射器可以用于基于第一输入数据生成第一结果数据。 基于第一结果数据，映射器可以用于生成（K，V）对。 减速器可以用于接收（K，V）对并基于（K，V）对产生第二输入数据。 减速器可以用于将第二输入数据传送到在减速器内运行的积分计算运行时环境，并可操作以基于第二输入数据生成第二结果数据。 基于第二结果数据，减速器可以用于产生输出数据。