摘要:
Methods, systems, and apparatuses for processing function calls using a hooking routines to perform pre-execution tasks are disclosed. A server computer receives a function call including a hooking routine and a request to run a particular function from a client computer. Based on a function group identifier and the credentials of the user or client computer, the server computer can perform various pre-execution tasks. The tasks can be common to all functions in the function group or be customized Both pre-execution tasks can be stored remotely from the client computer, so that updates to the pre-execution task can be made without the need to update computer readable code stored on the client computer. If the pre-execution tasks, such as an authorization, passes, then the server computer can execute the requested function, the server computer can reject or abort the requested function.
摘要:
Disclosed is a user interface on a display for editing data transformations comprising an ETL process. A first display area presents a data representation of a data transformation. A second display area presents a view of input data, and a third display are presents a view of output data. User input to modify the data transformation is received. In response to receiving the user input, the third display area is updated with output data generated by applying the modified data transformation to the input data.
摘要:
A computer readable medium includes executable instructions to receive a request to compare a first data set and a second data set. Data from the first data set and the second data set is ordered to comply with specified criteria and thereby form ordered data. The ordered data is joined to produce profile data.
摘要:
Methods, systems, and apparatuses for processing function calls using a hooking routines to perform pre-execution tasks are disclosed. A server computer receives a function call including a hooking routine and a request to run a particular function from a client computer. Based on a function group identifier and the credentials of the user or client computer, the server computer can perform various pre-execution tasks. The tasks can be common to all functions in the function group or be customized Both pre-execution tasks can be stored remotely from the client computer, so that updates to the pre-execution task can be made without the need to update computer readable code stored on the client computer. If the pre-execution tasks, such as an authorization, passes, then the server computer can execute the requested function, the server computer can reject or abort the requested function.
摘要:
A dataflow design tool allows users to provide data mappings from source database tables to a target database table. The tool provides metadata-driven views of the database tables and data-driven views of the database tables. Views of the database tables may be flipped between the metadata driven format and the data-driven format.
摘要:
In one embodiment, the method includes profiling a data file comprising one or more fields of data. The one or more fields of data contain an item of data; that is, a character, or group of characters that are related. Further, the method includes generating one or more profiling attributes based on profiling the data file. In an example, the one or more profiling attributes refer to profiling information relating to pattern, structure, content and format of data. Further, the method includes selecting at least one of the generated one or more profiling attributes and generating a validation rule based on the selected at least one profiling attribute.
摘要:
Systems and methods for resuming data transformations, such as broken or otherwise unsuccessful data transformations, are described. In some example embodiments, the systems and methods receive a message that indicates a broken data transformation of a data table between a source database and a destination database, identify a maximum and/or largest and greatest value for a date attribute contained within an index column for all rows of the data table that were successfully loaded to the destination database during the data transformation, and select a group of rows of data of the data table stored in the source database by querying the source database to identify rows that include a value for the date attribute that is greater than the identified value.
摘要:
Systems and methods for resuming data transformations, such as broken or otherwise unsuccessful data transformations, are described. In some example embodiments, the systems and methods receive a message that indicates a broken data transformation of a data table between a source database and a destination database, identify a maximum and/or largest and greatest value for a date attribute contained within an index column for all rows of the data table that were successfully loaded to the destination database during the data transformation, and select a group of rows of data of the data table stored in the source database by querying the source database to identify rows that include a value for the date attribute that is greater than the identified value.
摘要:
A data transform leverages a known hierarchy within a target data structure, in order to improve query and mapping capabilities and enhance performance. Where a target data structure is hierarchical, output data of that target data structure is often built in the document order of the nodes in the structure (from top down and from left to right). Hence, when the data for a child node in the target structure is being built, the data for the parent nodes of the child node has been built. Embodiments utilize this available portion of the target data in the form of target columns, to increase processing efficiency of the transformation process. Use of target columns according to embodiments may also allow powerful and concise expression of mapping logic in the transform, facilitating the use of functions such as selection (e.g. Where clauses), uniqueness (e.g. DISTINCT), ordering (Order By, Group By), and Aggregation.
摘要:
A method and system of retrying to load data from a data source to a cloud target system are disclosed. A client device sends a data packet to a cloud server via a communication connection. The data packet comprises data. The client device receives an indication of a failure in the communication connection. The client device configures, in response to receiving the indication of the failure in the communication connection, the data packet to prompt the cloud server to perform an upsert operation with the data in the data packet. The client device sends the configured data packet to the cloud server. The client device can wait a predetermined amount of time before sending the configured data packet to the cloud server.