STORING DATABASE METADATA IN MULTIPLE LEVELS

    公开(公告)号:US20210019334A1

    公开(公告)日:2021-01-21

    申请号:US17062859

    申请日:2020-10-05

    Applicant: Snowflake Inc.

    Abstract: The subject technology stores database data in a table, the table comprising a plurality of micro-partitions each having rows and columns. The subject technology stores metadata for the table in a data structure, the metadata comprising a first level of the data structure comprising a column expression property comprising information about data stored in a column of a micro-partition of the table, a micro-partition expression property comprising information about data stored in the micro-partition of the table, and a second level of the data structure comprising a grouping expression property comprising information about data stored in the micro-partition and one or more additional micro-partitions of the table.

    MULTI-LEVEL METADATA IN DATABASE SYSTEMS
    22.
    发明申请

    公开(公告)号:US20200272638A1

    公开(公告)日:2020-08-27

    申请号:US16775092

    申请日:2020-01-28

    Applicant: Snowflake Inc

    Abstract: Systems, methods, and devices for multiple level metadata organization in database systems. A system includes a plurality of shared storage devices collectively storing database data across a plurality of tables that each comprise one or more micro-partitions including immutable storage devices. The system includes a resource manager configured to manage the storage of database data stored in a table across one or more of the plurality of shared storage devices. The resource manager is configured to manage the storage of metadata for the table. The metadata includes a column expression property with information about data stored in a column, a micro-partition expression property with information about data stored in a micro-partition, a grouping expression property with information about data stored in two or more micro-partitions, and cumulative table metadata with global information about all micro-partitions of the table.

    STORING MULTI-LEVEL METADATA IN DATABASE SYSTEMS

    公开(公告)号:US20200272628A1

    公开(公告)日:2020-08-27

    申请号:US16863831

    申请日:2020-04-30

    Applicant: Snowflake Inc.

    Abstract: The subject technology receives first metadata corresponding to a set of micro-partitions. The subject technology generates second metadata for a grouping of the first metadata. The subject technology generates a first data structure including the first metadata and a second data structure including the second metadata, the second data structure including information associating the second metadata to the first metadata. The subject technology stores the first data structure and the second data structure in persistent storage as a first file and a second file. The subject technology receives a query on a table. Further, the subject technology analyzes the query against cumulative table metadata to determine whether data stored in the table matches the query.

    Data pruning based on metadata
    25.
    发明授权

    公开(公告)号:US10678753B2

    公开(公告)日:2020-06-09

    申请号:US16688888

    申请日:2019-11-19

    Applicant: Snowflake Inc.

    Abstract: A system and method for pruning data based on metadata. The method may include receiving a query that includes a plurality of predicates and identifying one or more applicable files including database data satisfying at least one of the plurality of predicates. The identifying the one or more applicable files including reading metadata stored in a metadata store that is separate from the database data. The method further includes pruning inapplicable files comprising database data that does not satisfy at least one of the plurality of predicates to create a reduced set of files and reading the reduced set of files to execute the query.

    Cloning catalog objects
    26.
    发明授权

    公开(公告)号:US11928129B1

    公开(公告)日:2024-03-12

    申请号:US18084795

    申请日:2022-12-20

    Applicant: SNOWFLAKE INC.

    CPC classification number: G06F16/27

    Abstract: Example systems and methods for cloning catalog objects are described. In one implementation, a method includes creating a second catalog object by mapping a second portion of second metadata of the second catalog object to same data of a same data file as a first portion of first metadata of a first catalog object, and, in response to a data storage or data retrieval request directed to the second catalog object, deleting data associated with the second portion of the second metadata from the second catalog object independently of the first catalog object.

    CLONING CATALOG OBJECTS
    29.
    发明申请

    公开(公告)号:US20210205120A1

    公开(公告)日:2021-07-08

    申请号:US17207508

    申请日:2021-03-19

    Abstract: Example systems and methods for cloning catalog objects are described. In one implementation, a method identifies an original catalog object associated with data and creates a duplicate copy of the original catalog object without copying the data itself. The method allows access to the data using the duplicate catalog object and supports modifying the data associated with the original catalog object independently of the duplicate catalog object. The duplicate catalog object can be deleted upon completion of modifying the data associated with the original catalog object.

Patent Agency Ranking