- 专利标题: MANAGING PROVENANCE INFORMATION FOR DATA PROCESSING PIPELINES
-
申请号: US17780427申请日: 2019-11-29
-
公开(公告)号: US20230004322A1公开(公告)日: 2023-01-05
- 发明人: Sambit NAYAK , Fredrik SVENSSON , Anshu SHUKLA
- 申请人: Telefonaktiebolaget LM Ericsson (publ)
- 申请人地址: SE Stockholm
- 专利权人: Telefonaktiebolaget LM Ericsson (publ)
- 当前专利权人: Telefonaktiebolaget LM Ericsson (publ)
- 当前专利权人地址: SE Stockholm
- 国际申请: PCT/EP2019/083117 WO 20191129
- 主分类号: G06F3/06
- IPC分类号: G06F3/06
摘要:
A method for managing provenance information associated to one or more interconnected provenance entities in a provenance system for data processing pipelines in a distributed cloud environment over a network interface, wherein each of the data processing pipelines is configured to read in data, transform the data, and output transformed data is disclosed. The method comprises steps being performed by a configuration component of obtaining at least one declarative intent representing a configuration indicative of requirements and levels of priority for storage of provenance information for each of the data processing pipelines, deriving the requirements and levels of priority for storage of provenance information for each of the data processing pipelines based on the obtained at least one declarative intent, wherein one of the levels of priority—first level of priority—is higher than the other levels of priority—second levels of priority, estimating storage capacity for storage of provenance information in the provenance system based on the derived requirements and levels of priority, storing the provenance information according to the derived requirements and levels of priority for storage of provenance information and for each of the data processing pipelines, and when actual storage consumption for storage of provenance information in the provenance system meets a threshold of storage capacity set based on the estimated storage capacity: reducing a data amount for storage of provenance information of the second levels of priority in the provenance system. Corresponding computer program product, arrangement, configuration component, and system are also disclosed.
公开/授权文献
- US1673103A Valve for lifting devices 公开/授权日:1928-06-12
信息查询