-
公开(公告)号:US20210248128A1
公开(公告)日:2021-08-12
申请号:US16787579
申请日:2020-02-11
发明人: Sundarrajan Raman , Ankita Jain , Prasad Dasari , Siva Chaitanya Thurlapati Venkata , Igor Yago , Oscar Lopez-Martinez , Ramamurthy Pavan Nallamothu , Padmanabham Ponnada , Jeff L. Howard
摘要: Systems for dynamically transforming data are provided. Database data may be received and ingested into a system. Ingesting the data may include executing one or more first data governance functions, such as data quality evaluation functions, data controls, and the like. The ingested data may then be output for further processing as first processed data and first data governance information may be captured and stored. The first processed data may be processed to execute one or more data transformations. Data transformations may include calculations, formatting, derivations, and the like. In some arrangements, second data governance functions may be executed on the transformed data. The transformed data may then be output as second processed data. The system may capture second data governance information as the data is transformed. The second processed data may then be published to one or more downstream databases for use in one or more applications executed by an entity.
-
公开(公告)号:US11086848B1
公开(公告)日:2021-08-10
申请号:US16787579
申请日:2020-02-11
发明人: Sundarrajan Raman , Ankita Jain , Prasad Dasari , Siva Chaitanya Thurlapati Venkata , Igor Yago , Oscar Lopez-Martinez , Ramamurthy Pavan Nallamothu , Padmanabham Ponnada , Jeff L. Howard
摘要: Systems for dynamically transforming data are provided. Database data may be received and ingested into a system. Ingesting the data may include executing one or more first data governance functions, such as data quality evaluation functions, data controls, and the like. The ingested data may then be output for further processing as first processed data and first data governance information may be captured and stored. The first processed data may be processed to execute one or more data transformations. Data transformations may include calculations, formatting, derivations, and the like. In some arrangements, second data governance functions may be executed on the transformed data. The transformed data may then be output as second processed data. The system may capture second data governance information as the data is transformed. The second processed data may then be published to one or more downstream databases for use in one or more applications executed by an entity.
-
公开(公告)号:US11520801B2
公开(公告)日:2022-12-06
申请号:US17094054
申请日:2020-11-10
发明人: Padmanabham Ponnada , Siva Chaitanya Thurlapati Venkata , Jeff L. Howard , John Popplewell , Ram Sekar , Oscar Lopez-Martinez , Igor Yago , Ramamurthy Pavan Nallamothu , Sundarrajan Raman
IPC分类号: G06F16/25 , G06F16/22 , G06F16/2453 , G06F16/2457 , G06F9/46
摘要: A system includes an execution engine and a processor. The execution engine receives application code that, when executed, is configured to generate a second data element from a first data element that is stored in a first database and store the second element in a second database. The execution engine converts the code into an execution plan and executes it. The execution plan includes a first operation to obtain the first element from the first database, a second operation to apply a transformation to the first element, and a third operation to store the first element as the second element in the second database. The processor accesses the execution plan and determines that the third operation includes storing the second element. In response, the processor generates a data lineage for the second element by extracting, from each operation from the third to the first, a portion of the data lineage.
-
公开(公告)号:US20220147539A1
公开(公告)日:2022-05-12
申请号:US17094054
申请日:2020-11-10
发明人: Padmanabham Ponnada , Siva Chaitanya Thurlapati Venkata , Jeff L. Howard , John Popplewell , Ram Sekar , Oscar Lopez-Martinez , Igor Yago , Ramamurthy Pavan Nallamothu , Sundarrajan Raman
IPC分类号: G06F16/25 , G06F16/2457 , G06F16/2453 , G06F16/22
摘要: A system includes an execution engine and a processor. The execution engine receives application code that, when executed, is configured to generate a second data element from a first data element that is stored in a first database and store the second element in a second database. The execution engine converts the code into an execution plan and executes it. The execution plan includes a first operation to obtain the first element from the first database, a second operation to apply a transformation to the first element, and a third operation to store the first element as the second element in the second database. The processor accesses the execution plan and determines that the third operation includes storing the second element. In response, the processor generates a data lineage for the second element by extracting, from each operation from the third to the first, a portion of the data lineage.
-
-
-