公开(公告)号：US20100175049A1

公开(公告)日：2010-07-08

申请号：US12349830

申请日：2009-01-07

Applicant: WILLIAM D. RAMSEY ,  RONNIE IRA CHAIKEN ,  DARREN A. SHAKIB ,  ROBERT JOHN JENKINS, JR. ,  SIMON J. WEAVER ,  JINGREN ZHOU ,  DANIEL DEDU-CONSTANTIN ,  ACHINT SRIVASTAVA

Inventor： WILLIAM D. RAMSEY ,  RONNIE IRA CHAIKEN ,  DARREN A. SHAKIB ,  ROBERT JOHN JENKINS, JR. ,  SIMON J. WEAVER ,  JINGREN ZHOU ,  DANIEL DEDU-CONSTANTIN ,  ACHINT SRIVASTAVA

IPC: G06F9/44 ,  G06F9/45 ,  G06F7/00

CPC classification number: G06F9/45512

Abstract: Embodiments of the present invention relate to systems, methods and computer storage media for providing Structured Computations Optimized for Parallel Execution (SCOPE) that facilitate analysis of a large-scale dataset utilizing row data of those data sets. SCOPE includes, among other features, an extract command for extracting data bytes from a data stream and structuring the data bytes as data rows having strictly defined columns. SCOPE also includes a process command and a reduce command that identify data rows as inputs. The reduce command also identifies a reduce key that facilitates the reduction based on the reduce key. SCOPE additionally includes a combine command that identifies two data row sets that are to be combined based on an identified joint condition. Additionally, SCOPE includes a select command that leverages SQL and C# languages to create an expressive script that is capable of analyzing large-scale data sets in a parallel computing environment.

Abstract translation: 本发明的实施例涉及用于提供用于并行执行优化的结构化计算（SCOPE）的系统，方法和计算机存储介质，其利用这些数据集的行数据便于对大规模数据集进行分析。 SCOPE以及其他特征包括从数据流提取数据字节并且将数据字节构造为具有严格定义的列的数据行的提取命令。 SCOPE还包括一个进程命令和一个将数据行标识为输入的reduce命令。 reduce命令还标识一个减号键，该减号键有助于减少键的减少。 SCOPE另外包括组合命令，其基于识别的联合条件标识要组合的两个数据行集。 另外，SCOPE还包括一个select命令，利用SQL和C＃语言来创建一个能够在并行计算环境中分析大规模数据集的表达式脚本。