-
公开(公告)号:US20200242118A1
公开(公告)日:2020-07-30
申请号:US16851800
申请日:2020-04-17
Applicant: SNOWFLAKE INC.
Inventor: Benoit Dageville , Jiansheng Huang , Shige Takeda , Abdul Q. Munir
IPC: G06F16/2453 , G06F16/11 , G06F16/16 , G06F16/2455 , G06F16/14
Abstract: A method, system, and apparatus for managing a persistent query result set are disclosed. A resource manager is disclosed that receives a query from a client over a computer network. A computer database server is disclosed that executes the query and generates a result set based on and in response to the received query. An execution platform is disclosed that divides the result set into a plurality of chunks, wherein each chunk comprises a portion of the generated result set. The resource manager adds metadata to each of the plurality of chunks. A first chunk of the plurality of chunks comprises metadata pointing to the plurality of chunks. The resource manager delivers at least the first chunk of the plurality of chunks to the client in response to the query. The execution platform offloads the remaining plurality of chunks to cloud storage in parallel.
-
公开(公告)号:US10713238B2
公开(公告)日:2020-07-14
申请号:US15812892
申请日:2017-11-14
Applicant: Snowflake Inc.
Inventor: Benoit Dageville , Martin Hentschel , William Waddington
IPC: G06F16/00 , G06F16/23 , G06F21/60 , G06F16/22 , G06F16/2455
Abstract: A method for a database system includes storing table data for a database, the table data including information in rows and columns of one or more database tables. The method includes storing metadata on immutable storage, the metadata including information about the table data for the database. In one embodiment, mutable metadata may be periodically consolidated in the background to create new versions of metadata files and which allows for deletions of old metadata files and old data files.
-
公开(公告)号:US20200210448A1
公开(公告)日:2020-07-02
申请号:US16814443
申请日:2020-03-10
Applicant: Snowflake Inc.
Inventor: Ashish Motivala , Benoit Dageville
IPC: G06F16/27 , G06F16/951 , G06F9/50 , H04L29/08 , G06F16/22 , G06F16/2455 , G06F9/48 , G06F16/182 , G06F16/2453 , G06F16/21 , G06F16/2458 , G06F16/23 , G06F16/14 , G06F16/9535
Abstract: Example systems and methods for cloning catalog objects are described. In one implementation, a method includes creating a copy of a catalog object without copying a data associated with the catalog object by only coping metadata associated with the object. The method further includes modifying, by one or more processors, the data associated with the catalog object independently of the copy of the catalog object.
-
公开(公告)号:US20200183909A1
公开(公告)日:2020-06-11
申请号:US16705566
申请日:2019-12-06
Applicant: Snowflake Inc.
Inventor: Subramanian Muralidhar , Istvan Cseri , Torsten Grabs , Benoit Dageville
IPC: G06F16/23 , G06F16/27 , G06F16/18 , G06F16/245
Abstract: Systems, methods, and devices for generating a transactional change tracking summary for a database. A method includes executing a transaction on a table of a database, wherein the table includes a micro-partition and the transaction is executed on the micro-partition. The method includes, in response to the transaction being fully executed, generating a change tracking entry comprising an indication of one or modifications made to the table by the transaction. The method includes storing the change tracking entry in a change tracking stream, wherein the change tracking stream includes one or more sequential change tracking entries that each correspond to a different transaction that is fully executed on the table
-
公开(公告)号:US20200012659A1
公开(公告)日:2020-01-09
申请号:US16392258
申请日:2019-04-23
Applicant: Snowflake Inc.
Inventor: Benoit Dageville , Eric Robinson , Martin Hentschel
IPC: G06F16/27 , G06F16/245
Abstract: Replication and failover of database data is disclosed. A method includes replicating database data stored in a primary deployment such that the database data is further stored in a secondary deployment. The method includes executing one or more updates to the database data at the secondary deployment when the primary deployment is unavailable and propagating the one or more updates to the primary deployment when the primary deployment becomes available again. The method includes executing queries on the database data at the primary deployment when the primary deployment is available.
-
公开(公告)号:US10437780B2
公开(公告)日:2019-10-08
申请号:US15210536
申请日:2016-07-14
Applicant: Snowflake Inc.
Inventor: Marcin Zukowski , Benoit Dageville , Thierry Cruanes , Ashish Motivala
IPC: G06F16/00 , G06F16/16 , G06F16/22 , G06F16/215 , G06F16/9535 , G06F16/2453
Abstract: A system, apparatus, and method for processing queries wherein the query includes a request to access or delete data and accessing metadata associated with the set of data, the metadata defining data characteristics of the set of data and identifying at least sets of data that need or not need to be accessed or deleted based on the metadata without accessing the actual data in the set of data; also methods to optimize processing of some operations based on the collected metadata on data.
-
公开(公告)号:US20190258607A1
公开(公告)日:2019-08-22
申请号:US16399448
申请日:2019-04-30
Applicant: Snowflake Inc.
Inventor: Marcin Zukowski , Benoit Dageville , Thierry Cruanes , Ashish Motivala
IPC: G06F16/16 , G06F16/2453 , G06F16/22 , G06F16/215 , G06F16/9535
Abstract: A system, apparatus, and method for processing queries wherein the query includes a request to access or delete data and accessing metadata associated with the set of data, the metadata defining data characteristics of the set of data and identifying at least sets of data that need or not need to be accessed or deleted based on the metadata without accessing the actual data in the set of data; also methods to optimize processing of some operations based on the collected metadata on data.
-
公开(公告)号:US12287760B2
公开(公告)日:2025-04-29
申请号:US18448512
申请日:2023-08-11
Applicant: Snowflake Inc.
Inventor: Marcin Zukowski , Benoit Dageville , Thierry Cruanes , Ashish Motivala
IPC: G06F16/00 , G06F16/16 , G06F16/215 , G06F16/22 , G06F16/2453 , G06F16/9535
Abstract: A system and method for pruning data based on metadata. The method may include receiving a query that includes a plurality of predicates and identifying one or more applicable files including database data satisfying at least one of the plurality of predicates. The identifying the one or more applicable files including reading metadata stored in a metadata store that is separate from the database data. The method further includes pruning inapplicable files including database data that does not satisfy at least one of the plurality of predicates to create a reduced set of files and reading the reduced set of files to execute the query.
-
公开(公告)号:US20250086193A1
公开(公告)日:2025-03-13
申请号:US18954797
申请日:2024-11-21
Applicant: Snowflake inc.
Abstract: Techniques for configuring a managed event table (MET) include detecting, by at least one hardware processor, a query for the MET. The query received at a first computing node of a network-based database system. The method includes retrieving via an ingestion function configured at the first computing node, reformatted data from a dedicated storage location of a first process into the MET. The reformatted data is based on log data associated with a second process. The first process and the second process are executing at a second computing node of the network-based database system. The method includes processing the query using the reformatted data in the MET.
-
公开(公告)号:US12235835B2
公开(公告)日:2025-02-25
申请号:US18526666
申请日:2023-12-01
Applicant: Snowflake Inc.
Inventor: Subramanian Muralidhar , Benoit Dageville , Thierry Cruanes , Nileema Shingte , Saurin Shah , Torsten Grabs , Istvan Cseri
IPC: G06F16/20 , G06F3/06 , G06F9/54 , G06F16/16 , G06F16/22 , G06F16/23 , G06F16/242 , G06F16/2455 , G06F16/25
Abstract: System and method for efficiently querying external tables are described herein. In an embodiment, a database platform receives a query that is directed at least in part to external data in an external table stored on a data storage platform that is external to the database platform. The external table includes a plurality of partitions. The database platform identifies, from external-table metadata, a subset of the plurality of partitions of the external table as including data that potentially satisfies the query. The external-table metadata is stored by the database platform. The database platform identifies data that satisfies the query by scanning the identified subset of the partitions, and responds to the query at least in part with the identified data that satisfies the query.
-
-
-
-
-
-
-
-
-