-
公开(公告)号:US20190026210A1
公开(公告)日:2019-01-24
申请号:US16137822
申请日:2018-09-21
Applicant: Ab Initio Technology LLC
Inventor: Mark Buxbaum , Michael G. Mulligan , Tim Wakeling , Matthew Darcy Atterbury
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for dynamic graph performance monitoring. One of the methods includes receiving input data by the data processing system, the input data provided by an application executing on the data processing system. The method includes determining a characteristic of the input data. The method includes identifying, by the application, a dynamic component from multiple available dynamic components based on the determined characteristic, the multiple available dynamic components being stored in a data storage system. The method includes processing the input data using the identified dynamic component. The method also includes determining one or more performance metrics associated with the processing.
-
公开(公告)号:US10176234B2
公开(公告)日:2019-01-08
申请号:US14738232
申请日:2015-06-12
Applicant: Ab Initio Technology LLC
Inventor: Joel Gould , Scott Studer
IPC: G06F17/30
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for impact analysis. One of the methods includes receiving information about at least two logical datasets, the information identifying, for each logical dataset, a field in that logical dataset and format information about that field. The method includes receiving information about a transformation identifying a first logical dataset from which the transformation is to receive data and a second logical dataset to which the transformed data is provided. The method includes receiving one or more proposed changes to at least one of the fields. The method includes analyzing the proposed changes based on information about the transformation and information about the first logical dataset and the second logical dataset. The method includes calculating metrics of the proposed change based on the analysis. The method also includes storing information about the metrics.
-
公开(公告)号:US10175974B2
公开(公告)日:2019-01-08
申请号:US14803396
申请日:2015-07-20
Applicant: Ab Initio Technology LLC
Inventor: Edward Bach , Richard Oberdorf , Brond Larson
Abstract: Managing lineage information includes: receiving lineage information representing one or more lineage relationships among two or more data processing programs and two or more logical datasets; receiving one or more runtime artifacts, each runtime artifact including information related to a previous execution of a data processing program of the two or more data processing programs; and analyzing the one or more runtime artifacts and the lineage information to determine one or more candidate modifications to the lineage information.
-
公开(公告)号:US10175951B2
公开(公告)日:2019-01-08
申请号:US14843084
申请日:2015-09-02
Applicant: Ab Initio Technology LLC
Inventor: Craig W. Stanfill , Adam Weiss , Andrew F. Roberts , Stephen A. Kukolich
Abstract: User input is received specifying components of a graph-based program specification. User input is received specifying links, at least some connecting an output port of an upstream component to an input port of a downstream component. The graph-based program specification is processed to identify one or more subsets of the components, including: identifying one or more subset entry points and one or more subset exit points that occur between components in different subsets based at least in part on data processing characteristics of linked components, and forming the subsets based on the identified subset entry points and exit points. A visual representation of the formed subsets is rendered within a user interface. Prepared code is generated for each formed subset that when used for execution by a runtime system causes processing tasks corresponding to the components in each formed subset to be performed.
-
55.
公开(公告)号:US20180349134A1
公开(公告)日:2018-12-06
申请号:US15917182
申请日:2018-03-09
Applicant: Ab Initio Technology LLC
Inventor: Scott Studer , Joel Gould , Amit Weisman
Abstract: A computer-implemented method for integrating client portals of underlying data processing applications through a shared log record, including: storing one or more log records that are each shared by the process management application and the version control application; receiving instructions through a user interface that integrates, through the shared one or more log records, the process management client portal with the version control client portal; in response to the receiving of the instructions, executing the received instructions, the executing of the received instructions including: selecting, by the version control application, a particular version of the rule from the multiple versions of the rule stored in the system storage; and transitioning, by the process management application, the particular version of the rule from the first state of the plurality of states to the second, different state of the plurality of states.
-
公开(公告)号:US10140329B2
公开(公告)日:2018-11-27
申请号:US15077108
申请日:2016-03-22
Applicant: Ab Initio Technology LLC
Inventor: Craig W. Stanfill
Abstract: Processing transactions in a distributed computing system that includes multiple processing modules includes: storing data items in a data storage system accessible to multiple processes running in the distributed computing system, where the data items are totally ordered according to an ordering rule, and at least some of the processes are running on different processing modules; and processing transactions using a plurality of the multiple processes. Processing a transaction using one of the plurality of the multiple processes includes: receiving a set of requests for accessing data items stored in the data storage system (where the requests are in a first order), obtaining locks on the data items sequentially in the first order if each of the locks is obtained within a first time interval, and, if any of the locks is not obtained within the first time interval, restarting the transaction being processed.
-
公开(公告)号:US10133500B2
公开(公告)日:2018-11-20
申请号:US13787055
申请日:2013-03-06
Applicant: Ab Initio Technology LLC
Inventor: Ephraim Meriwether Vishniac , Stephen J. Schmidt
Abstract: A system for managing storage of data units includes a data storage system configured to store multiple data blocks, at least some of the data blocks containing multiple data units, with at least a group of the data blocks being stored contiguously, thereby supporting a first read operation that retrieves data units from at least two adjacent data blocks in the group. The system is configured to perform two or more operations with respect to data units. The operations include: a second read operation, different from the first read operation, that retrieves a data unit to be read based at least in part on an address of a data block containing the data unit to be read, and a delete operation that replaces a first data block containing a data unit to be deleted with a second data block that does not contain the deleted data unit.
-
公开(公告)号:US10108521B2
公开(公告)日:2018-10-23
申请号:US13678928
申请日:2012-11-16
Applicant: Ab Initio Technology LLC
Inventor: Mark Buxbaum , Michael G Mulligan , Tim Wakeling , Matthew Darcy Atterbury
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for dynamic graph performance monitoring. One of the methods includes receiving input data by the data processing system, the input data provided by an application executing on the data processing system. The method includes determining a characteristic of the input data. The method includes identifying, by the application, a dynamic component from multiple available dynamic components based on the determined characteristic, the multiple available dynamic components being stored in a data storage system. The method includes processing the input data using the identified dynamic component. The method also includes determining one or more performance metrics associated with the processing.
-
公开(公告)号:US10067799B2
公开(公告)日:2018-09-04
申请号:US15698970
申请日:2017-09-08
Applicant: Ab Initio Technology LLC
Inventor: Craig W. Stanfill , Richard Shapiro , Adam Weiss , Andrew F. Roberts , Joseph Skeffington Wholey, III , Joel Gould
Abstract: Information representative of a graph-based program specification has a plurality of components, each of which corresponds to a task, and directed links between ports of said components. A program corresponding to said graph-based program specification is executed. A first component includes a first data port, a first control port, and a second control port. Said first data port is configured to receive data to be processed by a first task corresponding to said first component, or configured to provide data that was processed by said first task corresponding to said first component. Executing a program corresponding to said graph-based program specification includes: receiving said first control information at said first control port, in response to receiving said first control information, determining whether or not to invoke said first task, and after receiving said first control information, providing said second control information from said second control port.
-
公开(公告)号:US10037198B2
公开(公告)日:2018-07-31
申请号:US15234197
申请日:2016-08-11
Applicant: Ab Initio Technology LLC
Inventor: Craig W. Stanfill , Richard Shapiro
Abstract: A received graph-based program specification includes: a plurality of components, each corresponding to at least one operation; and a plurality of directed links each connecting an upstream component to a downstream component. Processed code is generated representing one or more groups of operations by: identifying a possible level of concurrency in a first group of operations based at least in part on a topology of the graph, such that multiple operations in the first group are not prevented by the topology of the graph from executing concurrently; analyzing at least some of the operations in the first group to determine runtime characteristics associated with the analyzed operations; and generating processed code for executing the operations, where the processed code enforces a reduced level of concurrency in the first group, lower than the identified possible level of concurrency, based at least in part on the determined runtime characteristics.
-
-
-
-
-
-
-
-
-