公开(公告)号：US09542462B1

公开(公告)日：2017-01-10

申请号：US13918615

申请日：2013-06-14

Applicant: Google Inc.

Inventor： Murray M. Stokely ,  Karl Millar

IPC: G06F17/30

CPC classification number: G06F17/30569 ,  G06F8/443 ,  G06F8/4435 ,  G06F17/30563

Abstract: A system and method for performing large-scale data processing using a statistical programming language are disclosed. One or more high-level statistical operations may be received. The received high-level statistical operations may be dynamically translated into a graph of low-level data operations. The unnecessary operations may be removed and operations may be fused or chained together. Operations may then be grouped into distributed data processing operation. The low-level operations may then be run.

Abstract translation: 公开了一种使用统计编程语言执行大规模数据处理的系统和方法。 可以接收一个或多个高级统计操作。 接收的高级统计操作可以动态地转换成低级数据操作的图形。 可能会删除不必要的操作，并将操作融合或链接在一起。 然后可以将操作分组为分布式数据处理操作。 然后可以运行低级操作。