-
公开(公告)号:US12204523B2
公开(公告)日:2025-01-21
申请号:US18135078
申请日:2023-04-14
Applicant: Databricks, Inc.
Inventor: Zhaoxing Li , Rayman Preet Singh , Fuat Can Efeoglu , Daniel Tenedorio , Sarah Cai
IPC: G06F16/00 , G06F16/23 , G06F16/2455
Abstract: A system for retrieving and caching metadata from a remote data source is described. The system may receive a request from a client device. The request is to perform a query operation on a set of data objects stored in the remote data source. The system may access a metadata cache storing metadata information on one or more data objects of the remote data source and identify metadata corresponding to the set of data objects for the query operation in the metadata cache. The system may determine whether the identified metadata for the set of data objects meets an update condition. In response to the identified metadata meeting the update condition, the system may fetch updated metadata for at least the set of data objects from the remote data source, and store the updated metadata in the metadata cache.
-
公开(公告)号:US20240346007A1
公开(公告)日:2024-10-17
申请号:US18135078
申请日:2023-04-14
Applicant: Databricks, Inc.
Inventor: Zhaoxing Li , Rayman Preet Singh , Fuat Can Efeoglu , Daniel Tenedorio , Sarah Cai
IPC: G06F16/23 , G06F16/2455
CPC classification number: G06F16/2365 , G06F16/24552
Abstract: A system for retrieving and caching metadata from a remote data source is described.
The system may receive a request from a client device. The request is to perform a query operation on a set of data objects stored in the remote data source. The system may access a metadata cache storing metadata information on one or more data objects of the remote data source and identify metadata corresponding to the set of data objects for the query operation in the metadata cache. The system may determine whether the identified metadata for the set of data objects meets an update condition. In response to the identified metadata meeting the update condition, the system may fetch updated metadata for at least the set of data objects from the remote data source, and store the updated metadata in the metadata cache.
-