公开(公告)号：US20220277024A1

公开(公告)日：2022-09-01

申请号：US17664144

申请日：2022-05-19

Applicant: Snowflake Inc.

Inventor： Vasile Paraschiv ,  Saurin Shah ,  Marianne Shaw ,  Nileeman Shingte

IPC: G06F16/27 ,  G06F16/28 ,  G06F9/30 ,  G06F16/22 ,  G06F16/2455 ,  G06F16/182 ,  G06F16/13 ,  G06F16/11 ,  G06F16/25

Abstract: A database export system exports data using a plurality of nodes that process the data to generate structured result files that are partitioned by an export parameter in an export request. The database export system distributes the data and merges the files to avoid small file creation and increase processing speed via parallelism. The database export system generates the result files of a specified maximum size in a final format, where the files are processed merged in a temporary file format. The parallel processing is optimized and constrained per the amount of processing nodes, available memory, requested final file sizes, and operation based ordering to complete data exports in a scalable multi-stage approach.