公开(公告)号：US11636114B2

公开(公告)日：2023-04-25

申请号：US17123551

申请日：2020-12-16

Applicant: Snowflake Inc.

Inventor： Benoit Dageville ,  Yi Fang ,  Martin Hentschel ,  Ashish Motivala ,  Spyridon Triantafyllis ,  Yizhi Zhu

IPC: G06F16/2455 ,  G06F16/23 ,  G06F16/2457 ,  G06F16/22 ,  G06F16/2458 ,  G06F16/27

Abstract: The subject technology receives first metadata corresponding to a set of micro-partitions. The subject technology stores a first data structure and a second data structure in storage as a first file and a second file, first data structure including the first metadata and a second data structure including second metadata, the first metadata corresponding to a set of micro-partitions, the second metadata for a grouping of the first metadata, the second data structure including information associating the second metadata to the first metadata. The subject technology stores third metadata for a table, the third metadata comprising information about data stored in a micro-partition of the table.

公开(公告)号：US11630845B2

公开(公告)日：2023-04-18

申请号：US17703804

申请日：2022-03-24

Applicant: Snowflake Inc.

Inventor： Benoit Dageville ,  Eric Robinson ,  Martin Hentschel

IPC: G06F16/00 ,  G06F16/27 ,  G06F16/245 ,  H04L67/1097

Abstract: Replication and failover of database data is disclosed. A method includes copying a first dataset of a first account stored in a primary deployment to a secondary deployment. The method includes determining that the first dataset stored in the primary deployment is unavailable. The method includes executing a first transaction on the first dataset at the secondary deployment in response to determining that the first dataset stored in the primary deployment is unavailable. The method includes executing a second transaction on a second dataset of a second account at the primary deployment while the first dataset of the first account stored in the primary deployment is unavailable.

公开(公告)号：US11620313B2

公开(公告)日：2023-04-04

申请号：US17118201

申请日：2020-12-10

Applicant: SNOWFLAKE INC.

Inventor： Florian Andreas Funke ,  Peter Povinec ,  Thierry Cruanes ,  Benoit Dageville

IPC: G06F16/28 ,  H04L67/1097 ,  G06F16/2455 ,  H04L41/0896 ,  H04L67/1008 ,  H04L41/5025 ,  G06F9/50 ,  H04L43/0817

Abstract: A method for a multi-cluster warehouse includes allocating a plurality of compute clusters as part of a virtual warehouse. The compute clusters are used to access and perform queries against one or more databases in one or more cloud storage resources. The method includes providing queries for the virtual warehouse to each of the plurality of compute clusters. Each of the plurality of compute clusters of the virtual warehouse receives a plurality of queries so that the computing load is spread across the different clusters. The method also includes dynamically adding compute clusters to and removing compute clusters from the virtual warehouse as needed based on a workload of the plurality of compute clusters.

公开(公告)号：US11615118B2

公开(公告)日：2023-03-28

申请号：US16862140

申请日：2020-04-29

Applicant: Snowflake Inc.

Inventor： Thierry Cruanes ,  Benoit Dageville ,  Florian Andreas Funke ,  Peter Povinec

IPC: G06F16/28 ,  H04L67/1097 ,  G06F16/2455 ,  H04L41/0896 ,  H04L67/1008 ,  H04L41/5025 ,  G06F9/50 ,  H04L43/0817

Abstract: A method for a multi-cluster warehouse includes allocating processing units as part of a data warehouse. The processing units access data within one or more databases in cloud storage resources. The method also includes providing one or more queries to each processing unit within the data warehouse. In response to the queries, each processing unit performs database operations on a particular portion of a database table. The method also includes monitoring a workload of the processing units to determine that a processing capacity of the processing units has reached a threshold processing capacity. The method also includes dynamically adding additional processing units to and removing processing units from the data warehouse as needed based on a workload of the processing units.

公开(公告)号：US11593404B2

公开(公告)日：2023-02-28

申请号：US16863758

申请日：2020-04-30

Applicant: Snowflake Inc.

Inventor： Thierry Cruanes ,  Benoit Dageville ,  Florian Andreas Funke ,  Peter Povinec

IPC: G06F16/28 ,  H04L67/1097 ,  G06F16/2455 ,  H04L41/0896 ,  H04L67/1008 ,  H04L41/5025 ,  G06F9/50 ,  H04L43/0817

Abstract: A method for a multi-cluster warehouse includes allocating processing units as part of a data warehouse. The processing units access data within one or more databases in cloud storage resources. The method also includes providing one or more queries to each processing unit within the data warehouse. In response to the queries, each processing unit performs database operations on a particular portion of a database table. The method also includes monitoring a workload of the processing units to determine that a processing capacity of the processing units has reached a threshold processing capacity. The method also includes dynamically adding additional processing units to and removing processing units from the data warehouse as needed based on a workload of the processing units.

公开(公告)号：US20230042949A1

公开(公告)日：2023-02-09

申请号：US17972003

申请日：2022-10-24

Applicant: SNOWFLAKE INC.

Inventor： Thierry Cruanes ,  Benoit Dageville ,  Allison Waingold Lee

IPC: G06F16/27 ,  G06F9/50 ,  G06F16/14 ,  G06F16/21 ,  G06F16/22 ,  G06F16/951 ,  G06F16/182 ,  G06F16/23 ,  G06F16/2455 ,  G06F16/2458 ,  G06F16/9535 ,  G06F16/2453 ,  H04L67/568 ,  A61F5/56 ,  G06F9/48 ,  H04L67/1095 ,  H04L67/1097

Abstract: A system and method for managing data storage and data access with querying data in a distributed system without buffering the results of intermediate operations in persistent storage. The method includes pushing, by a first operator, as a result of executing a query plan, an intermediate result to a plurality of secondary operators. Processing of the intermediate result by the plurality of secondary operators is delayed to coordinate generation of a plurality of second results based on beginning a final consumption operation of the plurality of second results.

公开(公告)号：US11507571B2

公开(公告)日：2022-11-22

申请号：US16385720

申请日：2019-04-16

Applicant: Snowflake Inc.

Inventor： Subramanian Muralidhar ,  Benoit Dageville ,  Thierry Cruanes ,  Nileema Shingte ,  Saurin Shah ,  Torsten Grabs ,  Istvan Cseri

IPC: G06F16/23 ,  G06F16/248 ,  G06F16/2458 ,  G06F3/06 ,  G06F16/25

Abstract: Systems, methods, and devices for generating a materialized view over an external table. A method includes connecting a database platform to an external table such that the database platform has read access for the external table and does not have write access for the external table. The method includes generating, by the database platform, a materialized view over the external table. The method includes receiving a notification that a modification has been made to the external table, the modification comprising one or more of an addition of a file, a deletion of a file, or an update to a file in a source location for the external table. The method includes, in response to the external table being modified, refreshing the materialized view such that the materialized view comprises an accurate representation of the external table.

公开(公告)号：US11494337B2

公开(公告)日：2022-11-08

申请号：US17508705

申请日：2021-10-22

Applicant: SNOWFLAKE INC.

Inventor： Thierry Cruanes ,  Benoit Dageville ,  Ashish Motivala ,  Marcin Zukowski

IPC: G06F16/00 ,  G06F16/16 ,  G06F16/22 ,  G06F16/215 ,  G06F16/9535 ,  G06F16/2453

Abstract: A system and method for pruning data based on metadata. The method may include receiving a query with a plurality of predicates and identifying one or more applicable files that includes database data satisfying at least one of the plurality of predicates. The identifying the one or more applicable files including reading metadata stored in a metadata store that is separate from the database data. The method further includes pruning inapplicable files comprising database data that does not satisfy at least one of the plurality of predicates to create a reduced set of files and reading the reduced set of files to execute the query.

公开(公告)号：US20220350795A1

公开(公告)日：2022-11-03

申请号：US17812878

申请日：2022-07-15

Applicant: Snowflake, Inc.

Inventor： Subramanian Muralidhar ,  Benoit Dageville ,  Thierry Cruanes ,  Nileema Shringte ,  Saurin Shah ,  Torsten Grabs ,  Istvan Cseri

IPC: G06F16/242 ,  G06F3/06 ,  G06F16/23 ,  G06F16/16 ,  G06F16/25 ,  G06F9/54 ,  G06F16/22 ,  G06F16/2455

Abstract: Disclosed herein are systems and methods for efficiently querying external tables. In an embodiment, a database platform receives a query that is directed at least in part to external data in an external table stored on a data storage platform that is external to the database platform. The external table includes a plurality of partitions. The database platform identifies, from external-table metadata, a subset of the plurality of partitions of the external table as including data that potentially satisfies the query. The external-table metadata is stored by the database platform. The database platform identifies data that satisfies the query by scanning the identified subset of the partitions, and responds to the query at least in part with the identified data that satisfies the query.

公开(公告)号：US20220292111A1

公开(公告)日：2022-09-15

申请号：US17832361

申请日：2022-06-03

Applicant: Snowflake, Inc.

Inventor： Ashish Motivala ,  Benoit Dageville

IPC: G06F16/27 ,  G06F9/50 ,  G06F16/14 ,  G06F16/21 ,  G06F16/22 ,  G06F16/951 ,  G06F16/182 ,  G06F16/23 ,  G06F16/2455 ,  G06F16/2458 ,  G06F16/9535 ,  G06F16/2453 ,  H04L67/568 ,  A61F5/56 ,  G06F9/48 ,  H04L67/1095 ,  H04L67/1097

Abstract: Example systems and methods for cloning catalog objects are described. In one implementation, a method identifies an original catalog object associated with data and creates a duplicate copy of the original catalog object without copying the data itself. The method allows access to the data using the duplicate catalog object and supports modifying the data associated with the original catalog object independently of the duplicate catalog object. The duplicate catalog object can be deleted upon completion of modifying the data associated with the original catalog object.