Abstract:
A method and system of retrying to load data from a data source to a cloud target system are disclosed. A client device sends a data packet to a cloud server via a communication connection. The data packet comprises data. The client device receives an indication of a failure in the communication connection. The client device configures, in response to receiving the indication of the failure in the communication connection, the data packet to prompt the cloud server to perform an upsert operation with the data in the data packet. The client device sends the configured data packet to the cloud server. The client device can wait a predetermined amount of time before sending the configured data packet to the cloud server.
Abstract:
Systems and methods for resuming data transformations, such as broken or otherwise unsuccessful data transformations, are described. In some example embodiments, the systems and methods receive a message that indicates a broken data transformation of a data table between a source database and a destination database, identify a maximum and/or largest and greatest value for a date attribute contained within an index column for all rows of the data table that were successfully loaded to the destination database during the data transformation, and select a group of rows of data of the data table stored in the source database by querying the source database to identify rows that include a value for the date attribute that is greater than the identified value.
Abstract:
Systems and methods for resuming data transformations, such as broken or otherwise unsuccessful data transformations, are described. In some example embodiments, the systems and methods receive a message that indicates a broken data transformation of a data table between a source database and a destination database, identify a maximum and/or largest and greatest value for a date attribute contained within an index column for all rows of the data table that were successfully loaded to the destination database during the data transformation, and select a group of rows of data of the data table stored in the source database by querying the source database to identify rows that include a value for the date attribute that is greater than the identified value.