-
公开(公告)号:US20240378177A1
公开(公告)日:2024-11-14
申请号:US18442567
申请日:2024-02-15
Applicant: Ab Initio Technology LLC
Inventor: Edward Alan Bach , Matthew Eads
Abstract: In an aspect, a method for migrating data records to a federated database system includes obtaining data records from a data source in a first federated database system; generating a data snapshot file based on the obtained data records and data indicative of a characteristic associated with the obtained data records; generating a hash of the data snapshot file to prevent modification of the data snapshot file; storing the data snapshot file and the generated hash in a data storage; migrating the obtained data records from the data snapshot file to a data target in a second federated database system, the migrating including: retrieving the data records from the data snapshot file stored in the data storage; providing the retrieved data records to the data target according to a mapping between a characteristic of the data source and a characteristic of the data target.
-
公开(公告)号:US20230112179A1
公开(公告)日:2023-04-13
申请号:US17704469
申请日:2022-03-25
Applicant: Ab Initio Technology LLC
Inventor: John Joyce , Marshall A. Isman , Edward Alan Bach
Abstract: A method for updating a computer program includes receiving a computer program hosted on and configured to be executed by a first computing system. The method includes analyzing the computer program to obtain characterization of a lineage, an architecture, and an operation of the computer program. The lineage includes relationships among elements of the computer program, the architecture includes a characteristic of the data source, the data target, and one or more processors configured to process the data contained in data records, and the operation includes processes that are executed to process the data from the data records. The method includes receiving a characterization of an update to be made to the computer program, in which when the computer program is modified according to the update, at least some of the modified computer program is configured to be hosted on and executed by a second computing system; and modifying the computer program to implement the update to generate the modified computer program.
-
公开(公告)号:US20220245125A1
公开(公告)日:2022-08-04
申请号:US17588965
申请日:2022-01-31
Applicant: Ab Initio Technology LLC
Inventor: Amit Weisman , Cory Christopher James Fantasia , Matthew Douglas Becker , Ian Robert Schechter , Edward Alan Bach , Robert Parks
Abstract: A data processing system with a dataset multiplexer that enables applications to be written to specify access to datasets as operations on logical datasets. During execution of an application by the data processing system, operations that access a dataset are implemented by accessing an entry in a dataset catalog for the logical dataset. That entry includes information to access the physical data source storing the logical dataset, including conversion of data from the format of the physical data source to the format of the logical dataset. An entry in the catalog may be created based on registration of a data source with the dataset multiplexer and may be updated automatically based on changes in storage of the dataset. This maintenance of the catalog may be partially or totally automated such that the system automatically adjusts to any changes in storage of the dataset without need for modification of any application.
-
公开(公告)号:US20210191845A1
公开(公告)日:2021-06-24
申请号:US16884138
申请日:2020-05-27
Applicant: Ab Initio Technology LLC
Inventor: Edward Alan Bach , Victor Abaya , Matthew Eads , Carl Offner , Matthew Zinno
IPC: G06F11/36 , G06F16/901
Abstract: A data processing system defines a unit test for a dataflow graph comprising a plurality of executable components. The system receives an indication of a portion of a dataflow graph for testing. The system receives a parameter set indicating expected output data to be generated by execution of a component of the graph. The system receives input data for the component. The input data are indicated by the parameter set and configured to test a functionality of the component. The system defines a unit test of the component based on the parameter set. The unit test provides the input data to inputs of the dataflow graph, causes processing of the input data by the component of the dataflow graph to generate output data, and generates results data indicating a correspondence between the output data and the expected output data indicated by the parameter.
-
公开(公告)号:US11372631B2
公开(公告)日:2022-06-28
申请号:US17216944
申请日:2021-03-30
Applicant: Ab Initio Technology LLC
Inventor: Edward Alan Bach , Richard A. Shapiro
Abstract: A method for generating an updated graph based on a base graph includes identifying differences between a base graph and each of a source and a target graph. The specification of each graph defines nodes representing data processing components defining operations for processing data, and links representing flow of data. The identifying includes: comparing specifications of base and source graphs to identify a first set of differences between the base and source graph, and comparing specifications of base and target graphs to identify a second set of differences between the base and the target graph. The method includes characterizing a correspondence between the differences in the first set and the differences in the second set, determining a set of combined differences based on the correspondence and the first and second sets of differences, and generating the updated graph based on the base graph and the set of combined differences.
-
公开(公告)号:US20210216290A1
公开(公告)日:2021-07-15
申请号:US17216944
申请日:2021-03-30
Applicant: Ab Initio Technology LLC
Inventor: Edward Alan Bach , Richard A. Shapiro
Abstract: A method for generating an updated graph based on a base graph includes identifying differences between a base graph and each of a source and a target graph. The specification of each graph defines nodes representing data processing components defining operations for processing data, and links representing flow of data. The identifying includes: comparing specifications of base and source graphs to identify a first set of differences between the base and source graph, and comparing specifications of base and target graphs to identify a second set of differences between the base and the target graph. The method includes characterizing a correspondence between the differences in the first set and the differences in the second set, determining a set of combined differences based on the correspondence and the first and second sets of differences, and generating the updated graph based on the base graph and the set of combined differences.
-
公开(公告)号:US10990364B2
公开(公告)日:2021-04-27
申请号:US16153320
申请日:2018-10-05
Applicant: Ab Initio Technology LLC
Inventor: Edward Alan Bach , Richard A. Shapiro
Abstract: A method for generating an updated graph based on a base graph includes identifying differences between a base graph and each of a source and a target graph. The specification of each graph defines nodes representing data processing components defining operations for processing data, and links representing flow of data. The identifying includes: comparing specifications of base and source graphs to identify a first set of differences between the base and source graph, and comparing specifications of base and target graphs to identify a second set of differences between the base and the target graph. The method includes characterizing a correspondence between the differences in the first set and the differences in the second set, determining a set of combined differences based on the correspondence and the first and second sets of differences, and generating the updated graph based on the base graph and the set of combined differences.
-
-
-
-
-
-