Invention Application
- Patent Title: BATCH DATA INGESTION IN DATABASE SYSTEMS
-
Application No.: PCT/US2018/062652Application Date: 2018-11-27
-
Publication No.: WO2019104338A1Publication Date: 2019-05-31
- Inventor: HUANG, Jiansheng , LIANG, Jiaxing , ZIEGLER, Scott , YU, Haowei , DAGEVILLE, Benoit , GANESH, Varun
- Applicant: SNOWFLAKE COMPUTING INC
- Applicant Address: 101 S Ellsworth Ave #350 San Mateo, CA 94401 US
- Assignee: SNOWFLAKE COMPUTING INC
- Current Assignee: SNOWFLAKE COMPUTING INC
- Current Assignee Address: 101 S Ellsworth Ave #350 San Mateo, CA 94401 US
- Agency: STEVENS, David, R.
- Priority: US62/591,118 20171127
- Main IPC: G06F16/00
- IPC: G06F16/00
Abstract:
Systems, methods, and devices for batch ingestion of data into a table of a database. A method includes determining a notification indicating a presence of a user file received from a client account to be ingested into a database. The method includes identifying data in the user file and identifying a target table of the database to receive the data in the user file. The method includes generating an ingest task indicating the data and the target table. The method includes assigning the ingest task to an execution node of an execution platform, wherein the execution platform comprises a plurality of execution nodes operating independent of a plurality of shared storage devices collectively storing database data. The method includes registering metadata concerning the target table in a metadata store after the data has been fully committed to the target table by the execution node.
Information query