公开(公告)号：US20230359668A1

公开(公告)日：2023-11-09

申请号：US18114212

申请日：2023-02-24

申请人： Ab Initio Technology LLC

发明人： Ian Robert Schechter ,  Garth Allen Dickie ,  Jonah Egenolf ,  Marshall Isman

IPC分类号： G06F16/901

CPC分类号： G06F16/9024

摘要： Described herein are techniques, performed by a data processing system, for enabling efficient development of software application programs in a dynamic environment with multiple datasets by generating entries in a dataset catalog to provide a software application program with access to output data dynamically generated by dataflow graphs, the entries associated with respective software application programs developed as dataflow graphs. The techniques include identifying a subgraph, wherein, when the subgraph is executed, the subgraph generates output data by applying one or more data processing operations to data obtained from one or more data sources; creating, in the dataset catalog, a new entry associated with the identified subgraph, the new entry associated with information indicating nodes, links, and configuration parameters of the identified subgraph; and configuring the dataset catalog to enable access to the new entry, in the dataset catalog, associated with the identified subgraph.