-
公开(公告)号:US20220019599A1
公开(公告)日:2022-01-20
申请号:US17491357
申请日:2021-09-30
Applicant: SNOWFLAKE INC.
Inventor: Ashish Motivala , Benoit Dageville
IPC: G06F16/27 , G06F9/50 , G06F16/14 , G06F16/21 , G06F16/22 , G06F16/951 , G06F16/182 , G06F16/23 , G06F16/2455 , G06F16/2458 , G06F16/9535 , G06F16/2453 , G06F9/48 , H04L29/08
Abstract: Example systems and methods for cloning catalog objects are described. In one implementation, a method includes creating a copy of a catalog object without copying a data associated with the catalog object by only coping metadata associated with the object. The method further includes modifying, by one or more processors, the data associated with the catalog object independently of the copy of the catalog object such that modified data is not visible to the copy of the catalog object and wherein the modified data is not visible to the catalog object in a database. The method further includes deleting the copy of the catalog object following completion of the modification of the data associated with the catalog object.
-
公开(公告)号:US11151160B2
公开(公告)日:2021-10-19
申请号:US16814443
申请日:2020-03-10
Applicant: Snowflake Inc.
Inventor: Ashish Motivala , Benoit Dageville
IPC: G06F16/00 , G06F16/27 , G06F9/50 , G06F16/14 , G06F16/21 , G06F16/22 , G06F16/951 , G06F16/182 , G06F16/23 , G06F16/2455 , G06F16/2458 , G06F16/9535 , G06F16/2453 , G06F9/48 , H04L29/08
Abstract: Example systems and methods for cloning catalog objects are described. In one implementation, a method includes creating a copy of a catalog object without copying a data associated with the catalog object by only coping metadata associated with the object. The method further includes modifying, by one or more processors, the data associated with the catalog object independently of the copy of the catalog object.
-
公开(公告)号:US11055291B2
公开(公告)日:2021-07-06
申请号:US17086275
申请日:2020-10-30
Applicant: Snowflake Inc.
Inventor: Benoit Dageville , Yi Fang , Martin Hentschel , Ashish Motivala , Spyridon Triantafyllis , Yizhi Zhu
IPC: G06F16/2455 , G06F16/23 , G06F16/2457 , G06F16/22 , G06F16/2458 , G06F16/27
Abstract: The subject technology generates a first data structure including first metadata and a second data structure including second metadata, the first metadata corresponding to a set of micro-partitions, the second metadata for a grouping of the first metadata, the second data structure including information associating the second metadata to the first metadata. The subject technology stores the first data structure and the second data structure in storage as a first file and a second file. The subject technology stores third metadata for a table, the third metadata comprising: cumulative table metadata comprising global information about a plurality of micro-partitions of the table, the cumulative table metadata being stored in a metadata micro-partition associated with the table.
-
公开(公告)号:US10997212B2
公开(公告)日:2021-05-04
申请号:US17062859
申请日:2020-10-05
Applicant: Snowflake Inc.
Inventor: Ashish Motivala , Yi Fang , Martin Hentschel , Benoit Dageville , Spyridon Triantafyllis , Yizhi Zhu
IPC: G06F16/27 , G06F16/245 , G06F16/22
Abstract: The subject technology stores database data in a table, the table comprising a plurality of micro-partitions each having rows and columns. The subject technology stores metadata for the table in a data structure, the metadata comprising a first level of the data structure comprising a column expression property comprising information about data stored in a column of a micro-partition of the table, a micro-partition expression property comprising information about data stored in the micro-partition of the table, and a second level of the data structure comprising a grouping expression property comprising information about data stored in the micro-partition and one or more additional micro-partitions of the table.
-
公开(公告)号:US10977278B2
公开(公告)日:2021-04-13
申请号:US16283431
申请日:2019-02-22
Applicant: Snowflake Inc.
Inventor: Ashish Motivala , Yi Fang , Martin Hentschel , Benoit Dageville , Spyros Triantafyllis , Yizhi Zhu
IPC: G06F16/27 , G06F16/245 , G06F16/22
Abstract: Systems, methods, and devices for multiple level metadata organization in database systems. A system includes a plurality of shared storage devices collectively storing database data across a plurality of tables that each comprise one or more micro-partitions constituting immutable storage devices. The system includes a resource manager configured to manage the storage of database data stored in a table across one or more of the plurality of shared storage devices. The resource manager is configured to manage the storage of metadata for the table. The metadata includes a column expression property with information about data stored in a column, a micro-partition expression property with information about data stored in a micro-partition, a grouping expression property with information about data stored in two or more micro-partitions, and cumulative table metadata with global information about all micro-partitions of the table.
-
公开(公告)号:US20200301929A1
公开(公告)日:2020-09-24
申请号:US16863627
申请日:2020-04-30
Applicant: Snowflake Inc.
Inventor: Benoit Dageville , Yi Fang , Martin Hentschel , Ashish Motivala , Spyridon Triantafyllis , Yizhi Zhu
IPC: G06F16/2457 , G06F16/27 , G06F16/2455 , G06F16/22 , G06F16/2458
Abstract: The subject technology receives first metadata corresponding to a set of micro-partitions. The subject technology generates second metadata for a grouping of the first metadata. The subject technology generates a first data structure including the first metadata and a second data structure including the second metadata, the second data structure including information associating the second metadata to the first metadata. Further, the subject technology stores the first data structure and the second data structure in persistent storage as a first file and a second file.
-
公开(公告)号:US20200272637A1
公开(公告)日:2020-08-27
申请号:US16283431
申请日:2019-02-22
Applicant: Snowflake Inc.
Inventor: Ashish Motivala , Yi Fang , Martin Hentschel , Benoit Dageville , Spyros Triantafyllis , Yizhi Zhu
IPC: G06F16/27 , G06F16/245 , G06F16/22
Abstract: Systems, methods, and devices for multiple level metadata organization in database systems. A system includes a plurality of shared storage devices collectively storing database data across a plurality of tables that each comprise one or more micro-partitions constituting immutable storage devices. The system includes a resource manager configured to manage the storage of database data stored in a table across one or more of the plurality of shared storage devices. The resource manager is configured to manage the storage of metadata for the table. The metadata includes a column expression property with information about data stored in a column, a micro-partition expression property with information about data stored in a micro-partition, a grouping expression property with information about data stored in two or more micro-partitions, and cumulative table metadata with global information about all micro-partitions of the table.
-
公开(公告)号:US20200210448A1
公开(公告)日:2020-07-02
申请号:US16814443
申请日:2020-03-10
Applicant: Snowflake Inc.
Inventor: Ashish Motivala , Benoit Dageville
IPC: G06F16/27 , G06F16/951 , G06F9/50 , H04L29/08 , G06F16/22 , G06F16/2455 , G06F9/48 , G06F16/182 , G06F16/2453 , G06F16/21 , G06F16/2458 , G06F16/23 , G06F16/14 , G06F16/9535
Abstract: Example systems and methods for cloning catalog objects are described. In one implementation, a method includes creating a copy of a catalog object without copying a data associated with the catalog object by only coping metadata associated with the object. The method further includes modifying, by one or more processors, the data associated with the catalog object independently of the copy of the catalog object.
-
公开(公告)号:US10437780B2
公开(公告)日:2019-10-08
申请号:US15210536
申请日:2016-07-14
Applicant: Snowflake Inc.
Inventor: Marcin Zukowski , Benoit Dageville , Thierry Cruanes , Ashish Motivala
IPC: G06F16/00 , G06F16/16 , G06F16/22 , G06F16/215 , G06F16/9535 , G06F16/2453
Abstract: A system, apparatus, and method for processing queries wherein the query includes a request to access or delete data and accessing metadata associated with the set of data, the metadata defining data characteristics of the set of data and identifying at least sets of data that need or not need to be accessed or deleted based on the metadata without accessing the actual data in the set of data; also methods to optimize processing of some operations based on the collected metadata on data.
-
公开(公告)号:US20190258607A1
公开(公告)日:2019-08-22
申请号:US16399448
申请日:2019-04-30
Applicant: Snowflake Inc.
Inventor: Marcin Zukowski , Benoit Dageville , Thierry Cruanes , Ashish Motivala
IPC: G06F16/16 , G06F16/2453 , G06F16/22 , G06F16/215 , G06F16/9535
Abstract: A system, apparatus, and method for processing queries wherein the query includes a request to access or delete data and accessing metadata associated with the set of data, the metadata defining data characteristics of the set of data and identifying at least sets of data that need or not need to be accessed or deleted based on the metadata without accessing the actual data in the set of data; also methods to optimize processing of some operations based on the collected metadata on data.
-
-
-
-
-
-
-
-
-