-
公开(公告)号:US10909121B2
公开(公告)日:2021-02-02
申请号:US16863831
申请日:2020-04-30
Applicant: Snowflake Inc.
Inventor: Benoit Dageville , Yi Fang , Martin Hentschel , Ashish Motivala , Spyridon Triantafyllis , Yizhi Zhu
IPC: G06F16/2455 , G06F16/23 , G06F16/2457 , G06F16/22 , G06F16/2458 , G06F16/27
Abstract: The subject technology receives first metadata corresponding to a set of micro-partitions. The subject technology generates second metadata for a grouping of the first metadata. The subject technology generates a first data structure including the first metadata and a second data structure including the second metadata, the second data structure including information associating the second metadata to the first metadata. The subject technology stores the first data structure and the second data structure in persistent storage as a first file and a second file. The subject technology receives a query on a table. Further, the subject technology analyzes the query against cumulative table metadata to determine whether data stored in the table matches the query.
-
公开(公告)号:US10810232B2
公开(公告)日:2020-10-20
申请号:US16775092
申请日:2020-01-28
Applicant: Snowflake Inc.
Inventor: Ashish Motivala , Yi Fang , Martin Hentschel , Benoit Dageville , Spyros Triantafylis , Yizhi Zhu
IPC: G06F16/27 , G06F16/245 , G06F16/22
Abstract: Systems, methods, and devices for multiple level metadata organization in database systems. A system includes a plurality of shared storage devices collectively storing database data across a plurality of tables that each comprise one or more micro-partitions including immutable storage devices. The system includes a resource manager configured to manage the storage of database data stored in a table across one or more of the plurality of shared storage devices. The resource manager is configured to manage the storage of metadata for the table. The metadata includes a column expression property with information about data stored in a column, a micro-partition expression property with information about data stored in a micro-partition, a grouping expression property with information about data stored in two or more micro-partitions, and cumulative table metadata with global information about all micro-partitions of the table.
-
公开(公告)号:US20200089655A1
公开(公告)日:2020-03-19
申请号:US16688888
申请日:2019-11-19
Applicant: Snowflake Inc.
Inventor: Marcin Zukowski , Benoit Dageville , Thierry Cruanes , Ashish Motivala
IPC: G06F16/16 , G06F16/2453 , G06F16/9535 , G06F16/215 , G06F16/22
Abstract: A system and method for pruning data based on metadata. The method may include receiving a query comprising a plurality of predicates and identifying one or more applicable files comprising database data satisfying at least one of the plurality of predicates. The identifying the one or more applicable files including reading metadata stored in a metadata. store that is separate from the database data. The method further includes pruning inapplicable files comprising database data that does not satisfy at least one of the plurality of predicates to create a reduced set of files and reading the reduced set of files to execute the query.
-
公开(公告)号:US10534793B2
公开(公告)日:2020-01-14
申请号:US15171859
申请日:2016-06-02
Applicant: SNOWFLAKE INC.
Inventor: Ashish Motivala , Benoit Dageville
IPC: G06F16/00 , G06F16/27 , G06F9/50 , G06F16/14 , G06F16/21 , G06F16/22 , G06F16/951 , G06F16/182 , G06F16/23 , G06F16/2455 , G06F16/2458 , G06F16/9535 , G06F16/2453 , G06F9/48 , H04L29/08
Abstract: Example systems and methods for cloning catalog objects are described. In one implementation, a method identifies an original catalog object associated with a set of data and creates a duplicate copy of the original catalog object without copying the data itself. The method allows access to the set of data using the duplicate catalog object and supports modifying the data associated with the original catalog object independently of the duplicate catalog object. The duplicate catalog object can be deleted upon completion of modifying the data associated with the original catalog object.
-
公开(公告)号:US20240346044A1
公开(公告)日:2024-10-17
申请号:US18754836
申请日:2024-06-26
Applicant: Snowflake Inc.
Inventor: Ashish Motivala , Benoit Dageville
IPC: G06F16/27 , A61F5/56 , G06F9/48 , G06F9/50 , G06F16/14 , G06F16/182 , G06F16/21 , G06F16/22 , G06F16/23 , G06F16/2453 , G06F16/2455 , G06F16/2458 , G06F16/25 , G06F16/28 , G06F16/951 , G06F16/9535 , G06F16/9538 , H04L67/1095 , H04L67/1097 , H04L67/568
CPC classification number: G06F16/273 , A61F5/566 , G06F9/4881 , G06F9/5016 , G06F9/5044 , G06F9/5083 , G06F9/5088 , G06F16/148 , G06F16/1827 , G06F16/211 , G06F16/221 , G06F16/2365 , G06F16/24532 , G06F16/24545 , G06F16/24552 , G06F16/2456 , G06F16/2471 , G06F16/254 , G06F16/27 , G06F16/283 , G06F16/951 , G06F16/9535 , G06F16/9538 , H04L67/1095 , H04L67/1097 , H04L67/568
Abstract: A system and method of using a stateless node to process data of a catalog object. The method includes accessing a catalog object comprising metadata associated with a dataset. The method includes distributing, by one or more processors, a task to a stateless node to cause the stateless node to process the dataset without storing information indicative of a particular state of the stateless node.
-
公开(公告)号:US12050621B2
公开(公告)日:2024-07-30
申请号:US18362769
申请日:2023-07-31
Applicant: Snowflake Inc.
Inventor: Ashish Motivala , Benoit Dageville
IPC: G06F16/00 , A61F5/56 , G06F9/48 , G06F9/50 , G06F16/14 , G06F16/182 , G06F16/21 , G06F16/22 , G06F16/23 , G06F16/2453 , G06F16/2455 , G06F16/2458 , G06F16/25 , G06F16/27 , G06F16/28 , G06F16/951 , G06F16/9535 , G06F16/9538 , H04L67/1095 , H04L67/1097 , H04L67/568
CPC classification number: G06F16/273 , A61F5/566 , G06F9/4881 , G06F9/5016 , G06F9/5044 , G06F9/5083 , G06F9/5088 , G06F16/148 , G06F16/1827 , G06F16/211 , G06F16/221 , G06F16/2365 , G06F16/24532 , G06F16/24545 , G06F16/24552 , G06F16/2456 , G06F16/2471 , G06F16/254 , G06F16/27 , G06F16/283 , G06F16/951 , G06F16/9535 , G06F16/9538 , H04L67/1095 , H04L67/1097 , H04L67/568
Abstract: A system and method of using stateless nodes to process data of catalog objects. The method includes accessing a catalog object including metadata associated with a dataset. The method includes determining, based on the metadata, whether a stateless node is to process the dataset. The method includes detecting, by one or more processors, a failure associated with the stateless node in response to determining that the stateless node is to process the dataset. The method includes replacing the stateless node with a different node without recreating a particular state.
-
公开(公告)号:US20230376504A1
公开(公告)日:2023-11-23
申请号:US18362769
申请日:2023-07-31
Applicant: Snowflake Inc.
Inventor: Ashish Motivala , Benoit Dageville
IPC: G06F16/27 , G06F9/50 , G06F16/14 , G06F16/21 , G06F16/22 , G06F16/951 , G06F16/182 , G06F16/23 , G06F16/2455 , G06F16/2458 , G06F16/9535 , G06F16/2453 , H04L67/568 , G06F16/28 , G06F16/25 , A61F5/56 , G06F16/9538 , G06F9/48 , H04L67/1095 , H04L67/1097
CPC classification number: G06F16/273 , G06F9/5016 , G06F16/27 , G06F16/148 , G06F16/211 , G06F16/221 , G06F16/951 , G06F16/1827 , G06F16/2365 , G06F16/2456 , G06F16/2471 , G06F16/9535 , G06F16/24532 , G06F16/24545 , G06F16/24552 , H04L67/568 , G06F16/283 , G06F16/254 , A61F5/566 , G06F16/9538 , G06F9/4881 , G06F9/5088 , H04L67/1095 , G06F9/5044 , H04L67/1097 , G06F9/5083
Abstract: A system and method of using stateless nodes to process data of catalog objects. The method includes accessing a catalog object including metadata associated with a dataset. The method includes determining, based on the metadata, whether a stateless node is to process the dataset. The method includes detecting, by one or more processors, a failure associated with the stateless node in response to determining that the stateless node is to process the dataset. The method includes replacing the stateless node with a different node without recreating a particular state.
-
公开(公告)号:US11797483B2
公开(公告)日:2023-10-24
申请号:US17696620
申请日:2022-03-16
Applicant: Snowflake Inc.
Inventor: Marcin Zukowski , Benoit Dageville , Thierry Cruanes , Ashish Motivala
IPC: G06F16/00 , G06F16/16 , G06F16/22 , G06F16/215 , G06F16/9535 , G06F16/2453
CPC classification number: G06F16/162 , G06F16/215 , G06F16/22 , G06F16/24544 , G06F16/9535
Abstract: A system and method for pruning data based on metadata. The method may include receiving a query that includes a plurality of predicates and identifying one or more applicable files including database data satisfying at least one of the plurality of predicates. The identifying the one or more applicable files including reading metadata stored in a metadata store that is separate from the database data. The method further includes pruning inapplicable files including database data that does not satisfy at least one of the plurality of predicates to create a reduced set of files and reading the reduced set of files to execute the query.
-
公开(公告)号:US11347770B2
公开(公告)日:2022-05-31
申请号:US17491357
申请日:2021-09-30
Applicant: SNOWFLAKE INC.
Inventor: Ashish Motivala , Benoit Dageville
IPC: G06F16/00 , G06F16/27 , G06F9/50 , G06F16/14 , G06F16/21 , G06F16/22 , G06F16/951 , G06F16/182 , G06F16/23 , G06F16/2455 , G06F16/2458 , G06F16/9535 , G06F16/2453 , G06F9/48 , H04L67/1095 , H04L67/568 , H04L67/1097
Abstract: Example systems and methods for cloning catalog objects are described. In one implementation, a method includes creating a copy of a catalog object without copying a data associated with the catalog object by only coping metadata associated with the object. The method further includes modifying, by one or more processors, the data associated with the catalog object independently of the copy of the catalog object such that modified data is not visible to the copy of the catalog object and wherein the modified data is not visible to the catalog object in a database. The method further includes deleting the copy of the catalog object following completion of the modification of the data associated with the catalog object.
-
公开(公告)号:US11294861B2
公开(公告)日:2022-04-05
申请号:US17141165
申请日:2021-01-04
Applicant: Snowflake Inc.
Inventor: Thierry Cruanes , Benoit Dageville , Ashish Motivala , Marcin Zukowski
IPC: G06F16/00 , G06F16/16 , G06F16/22 , G06F16/215 , G06F16/9535 , G06F16/2453
Abstract: A system and method for pruning data based on metadata. The method may include receiving a query that includes a plurality of predicates and identifying one or more applicable files including database data satisfying at least one of the plurality of predicates. The identifying the one or more applicable files including reading metadata stored in a metadata store that is separate from the database data. The method further includes pruning inapplicable files comprising database data that does not satisfy at least one of the plurality of predicates to create a reduced set of files and reading the reduced set of files to execute the query.
-
-
-
-
-
-
-
-
-