公开(公告)号：WO2016036817A4

公开(公告)日：2016-04-28

申请号：PCT/US2015048085

申请日：2015-09-02

Applicant: AB INITIO TECHNOLOGY LLC

Inventor： STANFILL CRAIG W ,  SHAPIRO RICHARD ,  WEISS ADAM ,  ROBERTS ANDREW F ,  WHOLEY III JOSEPH SKEFFINGTON ,  GOULD JOEL ,  KUKOLICH STEPHEN A

IPC: G06F9/44 ,  G06F9/45 ,  G06F9/48 ,  G06F9/50

CPC classification number: G06F8/43 ,  G06F8/34 ,  G06F8/433 ,  G06F8/447 ,  G06F9/4436 ,  G06F9/44505 ,  G06F9/44521 ,  G06F9/5066 ,  G06F13/36

Abstract: A graph-based program specification (110) includes components corresponding to tasks and directed links between ports of the components, including: a first type of link configuration defined by respective output and input ports of linked components, and a second type of link configuration defined by respective output and input ports of linked components. A compiler (120) recognizes different types of link configurations and provides in a target program specification occurrences of a target primitive for executing a function for each occurrence of a data element flowing over a link of the second type. A computing node (152) initiates execution of the target program specification, and determines at runtime, for components associated with the occurrences of the target primitive, an order in which instances of tasks corresponding to the components are to be invoked, and/or a computing node on which instances of tasks corresponding to the components are to be executed.

Abstract translation: 基于图的程序规范（110）包括对应于组件的端口之间的任务和有向链接的组件，包括：由链接组件的相应输出和输入端口定义的第一类型链接配置和定义的第二类型链接配置 通过链接组件的相应输出和输入端口。 编译器（120）识别不同类型的链路配置，并在目标程序规范中提供目标基元的出现，用于执行针对在第二类型的链路上流动的数据元素的每次出现的功能。 计算节点（152）启动目标程序规范的执行，并且在运行时确定与目标原语的出现相关联的组件，其中调用与组件相对应的任务的实例的次序，和/或 计算节点，在该节点上将执行对应于该组件的任务的实例。

公开(公告)号：WO2016036819A8

公开(公告)日：2017-04-06

申请号：PCT/US2015048088

申请日：2015-09-02

Applicant: AB INITIO TECHNOLOGY LLC

Inventor： STANFILL CRAIG W ,  SHAPIRO RICHARD ,  KUKOLICH STEPHEN A

IPC: G06F9/45 ,  G06F9/44 ,  G06F9/50

CPC classification number: G06F17/30312 ,  G06F8/41 ,  G06F8/433 ,  G06F8/456 ,  G06F9/4436 ,  G06F9/5066 ,  G06F17/30958

Abstract: A graph-based program specification (628) includes: a plurality of components, each corresponding to a processing task and including one or more ports, including scalar data ports for sending or receiving a single data element and collection data ports for sending or receiving a collection of multiple data elements; and one or more links, each connecting an output port of an upstream component to an input port of a downstream component. Prepared code is generated representing subsets (630, 631) of the plurality of components, including: identifying one or more subset boundaries, including identifying one or more links connecting a collection data port of a component to a scalar data port of a component; forming the subsets based on the identified subset boundaries; and generating prepared code for each formed subset that when used for execution by a runtime system causes processing tasks corresponding to the components in each formed subset to be performed.

Abstract translation: 基于图形的程序规范（628）包括：多个组件，每个组件对应于处理任务并且包括一个或多个端口，包括用于发送或接收单个数据元素的标量数据端口以及用于发送或接收单个数据元素的收集数据端口 收集多个数据元素; 以及一个或多个链路，每个链路将上游组件的输出端口连接到下游组件的输入端口。 产生代表多个组件的子集（630,631）的准备代码，包括：识别一个或多个子集边界，包括识别将组件的集合数据端口连接到组件的标量数据端口的一个或多个链路; 基于所识别的子集边界形成子集; 以及为每个形成的子集生成准备的代码，当用于运行时系统执行时，将导致与每个形成的子集中的组件相对应的处理任务被执行。

公开(公告)号：WO2016036824A4

公开(公告)日：2016-04-28

申请号：PCT/US2015048094

申请日：2015-09-02

Applicant: AB INITIO TECHNOLOGY LLC

Inventor： STANFILL CRAIG W ,  WEISS ADAM ,  ROBERTS ANDREW F ,  KUKOLICH STEPHEN A

IPC: G06F9/44 ,  G06F9/45

CPC classification number: G06F8/10 ,  G06F3/0482 ,  G06F8/34 ,  G06F8/433 ,  G06F8/456 ,  G06F9/4436

Abstract: User input is received specifying components of a graph-based program specification (628). User input is received specifying links, at least some connecting an output port of an upstream component to an input port of a downstream component. The graph-based program specification is processed to identify one or more subsets (630, 631) of the components, including: identifying one or more subset entry points and one or more subset exit points that occur between components in different subsets based at least in part on data processing characteristics of linked components, and forming the subsets based on the identified subset entry points and exit points. A visual representation of the formed subsets is rendered within a user interface. Prepared code is generated for each formed subset that when used for execution by a runtime system causes processing tasks corresponding to the components in each formed subset to be performed.

Abstract translation: 用户输入被接收，指定基于图的程序规范的组件（628）。 用户输入接收到指定链接，至少有一些将上游组件的输出端口连接到下游组件的输入端口。 对基于图的程序规范进行处理以识别组件的一个或多个子集（630,631），包括：至少基于以下内容来识别在不同子组中的组件之间出现的一个或多个子集入口点和一个或多个子集出口点： 部分关于链接组件的数据处理特性，并且基于所识别的子集入口点和出口点来形成子集。 形成的子集的可视表示在用户界面内呈现。 为每个形成的子集生成准备的代码，当用于由运行时系统执行时，导致与每个形成的子集中的组件相对应的处理任务被执行。

公开(公告)号：WO2016036820A4

公开(公告)日：2016-05-06

申请号：PCT/US2015048089

申请日：2015-09-02

Applicant: AB INITIO TECHNOLOGY LLC

Inventor： STANFILL CRAIG W ,  SHAPIRO RICHARD ,  KUKOLICH STEPHEN A ,  WHOLEY III JOSEPH SKEFFINGTON

IPC: G06F9/44 ,  G06F9/48

CPC classification number: G06F9/44 ,  G06F8/34 ,  G06F9/4421 ,  G06F9/4423 ,  G06F9/4436 ,  G06F9/46 ,  G06F9/465 ,  G06F9/466 ,  G06F9/4843 ,  G06F9/4881

Abstract: A graph-based program specification (110) includes components, at least one having at least one input port for receiving a collection of data elements, or at least one collection type output port for providing a collection of data elements. Executing a program specified by the graph-based program specification at a computing node (152), includes: receiving data elements of a first collection into a first storage in a first order via a link connected to a collection type output port of a first component and an input port of a second component, and invoking a plurality of instances of a task corresponding to the second component to process data elements of the first collection, including retrieving the data elements from the first storage in a second order, without blocking invocation of any of the instances until after any particular instance completes processing one or more data elements.

Abstract translation: 基于图的程序规范（110）包括组件，至少一个组件具有至少一个用于接收数据元素集合的输入端口或至少一个用于提供数据元素集合的集合类型输出端口。 在计算节点（152）处执行由基于图的程序规范指定的程序包括：经由连接到第一组件的集合类型输出端口的链接以第一顺序将第一集合的数据元素接收到第一存储器中 以及第二组件的输入端口，并且调用对应于第二组件的任务的多个实例以处理第一集合的数据元素，包括以第二顺序从第一存储器中检索数据元素，而不阻止 直到任何特定实例完成处理一个或多个数据元素之后的任何实例。

公开(公告)号：WO2016036830A4

公开(公告)日：2016-04-21

申请号：PCT/US2015048100

申请日：2015-09-02

Applicant: AB INITIO TECHNOLOGY LLC

Inventor： STANFILL CRAIG W ,  SHAPIRO RICHARD ,  WEISS ADAM ,  ROBERTS ANDREW F ,  WHOLEY III JOSEPH SKEFFINGTON ,  GOULD JOEL ,  KUKOLICH STEPHEN A

IPC: G06F9/44 ,  G06F9/45 ,  G06F9/50

CPC classification number: G06F8/43 ,  G06F8/34 ,  G06F8/433 ,  G06F8/447 ,  G06F9/4436 ,  G06F9/44505 ,  G06F9/44521 ,  G06F9/5066 ,  G06F13/36

Abstract: A graph-based program specification (110) includes components corresponding to tasks and directed links between ports of the components, including: a first type of link configuration between ports of linked components, corresponding to transfer of control or transfer of a single data element, and a second type of link configuration between ports of linked components, corresponding to transfer of multiple data elements. A compiler (120) generates a target program specification including control code representing at least one control graph including graph nodes representing the components, where at least two are connected based on links of the first type. A computing node (152) initiates execution of the target program specification, and manages computing resources for links of the second type, the computing resources including at least one of: a buffer for storing data elements provided by an output port, or a buffer for storing data elements provided to an input port.

Abstract translation: 基于图的程序规范（110）包括对应于组件的端口之间的任务和有向链接的组件，包括：链接组件的端口之间的第一类链接配置，其对应于单个数据元素的控制或传送的传送， 以及链接组件的端口之间的第二类型的链接配置，其对应于多个数据元素的传送。 编译器（120）生成包括代表至少一个控制图的控制代码的目标程序规范，所述至少一个控制图包括表示组件的图节点，其中至少两个基于第一类型的链路连接。 计算节点（152）启动目标程序规范的执行，并且管理用于第二类型的链路的计算资源，所述计算资源包括以下中的至少一个：用于存储由输出端口提供的数据元素的缓冲器或用于 存储提供给输入端口的数据元素。