Invention Grant
- Patent Title: Low latency ingestion into a data system
-
Application No.: US17809931Application Date: 2022-06-30
-
Publication No.: US11775563B2Publication Date: 2023-10-03
- Inventor: Dhiraj Gupta , Subramanian Muralidhar
- Applicant: Snowflake Inc.
- Applicant Address: US MT Bozeman
- Assignee: Snowflake Inc.
- Current Assignee: Snowflake Inc.
- Current Assignee Address: US MT Bozeman
- Agency: Schwegman Lundberg & Woessner, P.A.
- Main IPC: G06F16/00
- IPC: G06F16/00 ; G06F16/27 ; G06F16/18 ; G06F16/2453 ; G06F16/25

Abstract:
Described herein are techniques for improving transfer of metadata from a metadata database to a database stored in a data system, such as a data warehouse. The metadata may be written into the metadata database with a version stamp, which is monotonic increasing register value, and a partition identifier, which can be generated using attribute values of the metadata. A plurality of readers can scan the metadata database based on version stamp and partition identifier values to export the metadata to a cloud storage location. From the cloud storage location, the exported data can be auto ingested into the database, which includes a journal and snapshot table.
Public/Granted literature
- US20230229672A1 LOW LATENCY INGESTION INTO A DATA SYSTEM Public/Granted day:2023-07-20
Information query