Invention Grant
- Patent Title: Low latency ingestion into a data system
-
Application No.: US17648228Application Date: 2022-01-18
-
Publication No.: US11487788B1Publication Date: 2022-11-01
- Inventor: Dhiraj Gupta , Subramanian Muralidhar
- Applicant: Snowflake Inc.
- Applicant Address: US MT Bozeman
- Assignee: Snowflake Inc.
- Current Assignee: Snowflake Inc.
- Current Assignee Address: US MT Bozeman
- Agency: Schwegman Lundberg & Woessner, P.A.
- Main IPC: G06F16/00
- IPC: G06F16/00 ; G06F16/27 ; G06F16/18 ; G06F16/2453 ; G06F16/25

Abstract:
Described herein are techniques for improving transfer of metadata from a metadata database to a database stored in a data system, such as a data warehouse. The metadata may be written into the metadata database with a version stamp, which is monotonic increasing register value, and a partition identifier, which can be generated using attribute values of the metadata. A plurality of readers can scan the metadata database based on version stamp and partition identifier values to export the metadata to a cloud storage location. From the cloud storage location, the exported data can be auto ingested into the database, which includes a journal and snapshot table.
Information query