-
公开(公告)号:US11422855B2
公开(公告)日:2022-08-23
申请号:US16858780
申请日:2020-04-27
发明人: Daniel Metz , David Malament , Prasad Dasari , Jeff L. Howard
摘要: A data set subscription tracking and termination system may include a distribute module, a publisher and a plurality of subscribers. The distribute module may receive a publication registration to register a publication. The distribute module may receive a subscription registration to register a subscription to the publication. The publication registration and/or subscription registration may include metadata relating to the publication and/or subscription. A metadata store, included in the distribute module, may store the publication registration and/or the subscription registration. The publisher may change the publication. The change to the publication may include adding and/or deleting rows and/or columns to, or from, the publication. The publisher may notify the distribute module of publication. The distribute module may transmit an alert to all subscribers notifying them of the publication changes. The distribute module may also terminate subscriptions that only include data elements that are deleted from the publication.
-
公开(公告)号:US20210248128A1
公开(公告)日:2021-08-12
申请号:US16787579
申请日:2020-02-11
发明人: Sundarrajan Raman , Ankita Jain , Prasad Dasari , Siva Chaitanya Thurlapati Venkata , Igor Yago , Oscar Lopez-Martinez , Ramamurthy Pavan Nallamothu , Padmanabham Ponnada , Jeff L. Howard
摘要: Systems for dynamically transforming data are provided. Database data may be received and ingested into a system. Ingesting the data may include executing one or more first data governance functions, such as data quality evaluation functions, data controls, and the like. The ingested data may then be output for further processing as first processed data and first data governance information may be captured and stored. The first processed data may be processed to execute one or more data transformations. Data transformations may include calculations, formatting, derivations, and the like. In some arrangements, second data governance functions may be executed on the transformed data. The transformed data may then be output as second processed data. The system may capture second data governance information as the data is transformed. The second processed data may then be published to one or more downstream databases for use in one or more applications executed by an entity.
-
公开(公告)号:US20220334872A1
公开(公告)日:2022-10-20
申请号:US17857088
申请日:2022-07-04
发明人: Daniel Metz , David Malament , Prasad Dasari , Jeff L. Howard
摘要: A data set subscription tracking and termination system may include a distribute module, a publisher and a plurality of subscribers. The distribute module may receive a publication registration to register a publication. The distribute module may receive a subscription registration to register a subscription to the publication. The publication registration and/or subscription registration may include metadata relating to the publication and/or subscription. A metadata store, included in the distribute module, may store the publication registration and/or the subscription registration. The publisher may change the publication. The change to the publication may include adding and/or deleting rows and/or columns to, or from, the publication. The publisher may notify the distribute module of publication. The distribute module may transmit an alert to all subscribers notifying them of the publication changes. The distribute module may also terminate subscriptions that only include data elements that are deleted from the publication.
-
公开(公告)号:US20210334132A1
公开(公告)日:2021-10-28
申请号:US16858780
申请日:2020-04-27
发明人: Daniel Metz , David Malament , Prasad Dasari , Jeff L. Howard
摘要: A data set subscription tracking and termination system may include a distribute module, a publisher and a plurality of subscribers. The distribute module may receive a publication registration to register a publication. The distribute module may receive a subscription registration to register a subscription to the publication. The publication registration and/or subscription registration may include metadata relating to the publication and/or subscription. A metadata store, included in the distribute module, may store the publication registration and/or the subscription registration. The publisher may change the publication. The change to the publication may include adding and/or deleting rows and/or columns to, or from, the publication. The publisher may notify the distribute module of publication. The distribute module may transmit an alert to all subscribers notifying them of the publication changes. The distribute module may also terminate subscriptions that only include data elements that are deleted from the publication.
-
5.
公开(公告)号:US11080072B1
公开(公告)日:2021-08-03
申请号:US16858777
申请日:2020-04-27
发明人: David Malament , Jeff L. Howard , Prasad Dasari , Daniel Metz
IPC分类号: G06F3/0482 , G06F9/451 , G06F3/0483 , G06F16/27 , G06F9/54
摘要: A user interface for interfacing with a trihybrid data movement, data governance and data provenance system is provided. The user interface may include an application selection drop-down field that enables selection of an application. The user interface may include a deliveries tab. When selected, the deliveries tab may display the status of user subscription deliveries. The user interface may include a resources tab. When selected, the resources tab may display publications and/or subscriptions that have been set up. When selected, the resources tab may enable a user to create a new publication. The user interface may include an approvals tab. When selected, the approvals tab may display approvals relating to subscriptions that have been requested. The user interface may include a data catalog tab. When selected, the data catalog tab may display a plurality of available publications, and enable a user to request a subscription to a publication.
-
公开(公告)号:US10698884B2
公开(公告)日:2020-06-30
申请号:US15804405
申请日:2017-11-06
发明人: Sundar Rajan Raman , Jeff L. Howard , Prasad L.v.k.d. Dasari , Lakshmikanth S. Nagapudi , Padmanabham Ponnada
摘要: Systems for providing dynamic lineage validation are provided. A system may receive mapping data from a computing device. The mapping data may be formatted used to generate one or more libraries. In some examples, the libraries may be stored and used in development of future processes. In some examples, one or more controls related to the process, mapping data, and the like, may be received. The system may execute the controls to determine whether data violates the one or more of the controls. If so, the system may prevent the associated process from executing. If the data does not violate one or more controls, the system may cause the process to execute. After executing the process, run time events may be collected. The run time events may be linked to the mapping data and may be used to validate data quality, data lineage, data accuracy, and the like.
-
公开(公告)号:US11604677B2
公开(公告)日:2023-03-14
申请号:US17857088
申请日:2022-07-04
发明人: Daniel Metz , David Malament , Prasad Dasari , Jeff L. Howard
摘要: A data set subscription tracking and termination system may include a distribute module, a publisher and a plurality of subscribers. The distribute module may receive a publication registration to register a publication. The distribute module may receive a subscription registration to register a subscription to the publication. The publication registration and/or subscription registration may include metadata relating to the publication and/or subscription. A metadata store, included in the distribute module, may store the publication registration and/or the subscription registration. The publisher may change the publication. The change to the publication may include adding and/or deleting rows and/or columns to, or from, the publication. The publisher may notify the distribute module of publication. The distribute module may transmit an alert to all subscribers notifying them of the publication changes. The distribute module may also terminate subscriptions that only include data elements that are deleted from the publication.
-
公开(公告)号:US11086848B1
公开(公告)日:2021-08-10
申请号:US16787579
申请日:2020-02-11
发明人: Sundarrajan Raman , Ankita Jain , Prasad Dasari , Siva Chaitanya Thurlapati Venkata , Igor Yago , Oscar Lopez-Martinez , Ramamurthy Pavan Nallamothu , Padmanabham Ponnada , Jeff L. Howard
摘要: Systems for dynamically transforming data are provided. Database data may be received and ingested into a system. Ingesting the data may include executing one or more first data governance functions, such as data quality evaluation functions, data controls, and the like. The ingested data may then be output for further processing as first processed data and first data governance information may be captured and stored. The first processed data may be processed to execute one or more data transformations. Data transformations may include calculations, formatting, derivations, and the like. In some arrangements, second data governance functions may be executed on the transformed data. The transformed data may then be output as second processed data. The system may capture second data governance information as the data is transformed. The second processed data may then be published to one or more downstream databases for use in one or more applications executed by an entity.
-
公开(公告)号:US20190138627A1
公开(公告)日:2019-05-09
申请号:US15804405
申请日:2017-11-06
发明人: Sundar Rajan Raman , Jeff L. Howard , Prasad L.v.k.d. Dasari , Lakshmikanth S. Nagapudi , Padmanabham Ponnada
CPC分类号: G06F16/2365 , G06F8/36 , G06F9/44521 , G06F16/258
摘要: Systems for providing dynamic lineage validation are provided. A system may receive mapping data from a computing device. The mapping data may be formatted used to generate one or more libraries. In some examples, the libraries may be stored and used in development of future processes. In some examples, one or more controls related to the process, mapping data, and the like, may be received. The system may execute the controls to determine whether data violates the one or more of the controls. If so, the system may prevent the associated process from executing. If the data does not violate one or more controls, the system may cause the process to execute. After executing the process, run time events may be collected. The run time events may be linked to the mapping data and may be used to validate data quality, data lineage, data accuracy, and the like.
-
公开(公告)号:US11520801B2
公开(公告)日:2022-12-06
申请号:US17094054
申请日:2020-11-10
发明人: Padmanabham Ponnada , Siva Chaitanya Thurlapati Venkata , Jeff L. Howard , John Popplewell , Ram Sekar , Oscar Lopez-Martinez , Igor Yago , Ramamurthy Pavan Nallamothu , Sundarrajan Raman
IPC分类号: G06F16/25 , G06F16/22 , G06F16/2453 , G06F16/2457 , G06F9/46
摘要: A system includes an execution engine and a processor. The execution engine receives application code that, when executed, is configured to generate a second data element from a first data element that is stored in a first database and store the second element in a second database. The execution engine converts the code into an execution plan and executes it. The execution plan includes a first operation to obtain the first element from the first database, a second operation to apply a transformation to the first element, and a third operation to store the first element as the second element in the second database. The processor accesses the execution plan and determines that the third operation includes storing the second element. In response, the processor generates a data lineage for the second element by extracting, from each operation from the third to the first, a portion of the data lineage.
-
-
-
-
-
-
-
-
-