Invention Grant
- Patent Title: Batch data ingestion
-
Application No.: US16942421Application Date: 2020-07-29
-
Publication No.: US10977245B2Publication Date: 2021-04-13
- Inventor: Benoit Dageville , Varun Ganesh , Jiansheng Huang , Jiaxing Liang , Haowei Yu , Scott Ziegler
- Applicant: Snowflake Inc.
- Applicant Address: US CA San Mateo
- Assignee: Snowflake Inc.
- Current Assignee: Snowflake Inc.
- Current Assignee Address: US CA San Mateo
- Agency: Schwegman Lundberg & Woessner, P.A.
- Main IPC: G06F17/00
- IPC: G06F17/00 ; G06F16/23 ; G06F16/22 ; G06F16/25

Abstract:
The subject technology obtains, at a database system, an ingest request to ingest one or more files into a table of a database. The subject technology, after obtaining the ingest request and prior to the ingesting of the one or more files, persists the one or more files in a file queue that corresponds to the table. The subject technology assigns the one or more files to one or more execution nodes to be ingested into the table. The subject technology operates an ingest puller to poll the file queue. The subject technology ingests, by the one or more execution nodes, the one or more files into one or more micro-partitions of the table via one or more pipes.
Information query