Scalable fine-grained resource count metrics for cloud-based data catalog service
摘要:
In some aspects, an aggregation system of a cloud system may receive, by an aggregation system of a cloud system and from a data catalog, one or more events from one or more data sources of the cloud system, the one or more data sources having one or more resource types. The aggregation system may store event data to a message queue. The aggregation system of a cloud system may process, by one or more workers of the cloud system, a subset of events from the message queue at a time. The aggregation system may for each event in the subset of events: determine whether an event source has been updated based on information in the event. The aggregation system may in accordance with a determination that the event source has been updated, send an updated status to a dashboard, the dashboard configured to be displayed on a user device.
信息查询
0/0