Abstract:
Specifications of dataflow graphs are generated and/or combined. A sub-graph interface (123) of a dataflow graph includes one or more flow junctions. A flow junction (204D) representing a connection between: a flow of data outside the sub-graph interface, and a flow of data inside the sub-graph interface. In some embodiments, information is processed to generate a combined dataflow graph specification (300), including: identifying an association between the sub-graph interface and the first dataflow graph specification, for at least a first flow junction, determining a direction associated with transferring a value of a descriptor, and transferring a value of a descriptor according to the determined direction. In some embodiments, a link (229) is rendered between the first flow junction and a second flow junction based on user input indicating a relationship between a first descriptor and a second descriptor.
Abstract:
A graph-based computation has a plurality of nodes representing graph components connected by one or more links representing data flows between the components. Preparing the computation includes: identifying at least a first set of components to process a plurality of transactions in the computation; and associating with a first transaction a first group of one or more data records and data operations corresponding to the data records, and associating with a second transaction a second group of one or more data records and data operations corresponding to the data records. Executing the computation to process at least the first and second transactions includes delaying execution by the first set of components of a data operation corresponding to an initial data record of the second group until after execution by the first set of components of a data operation corresponding to a final data record of the first group.