Pruning indexes to enhance database query processing

    公开(公告)号:US10769150B1

    公开(公告)日:2020-09-08

    申请号:US16727315

    申请日:2019-12-26

    Applicant: Snowflake Inc.

    Abstract: A source table organized into a set of micro-partitions is accessed by a network-based data warehouse. A pruning index is generated based on the source table. The pruning index comprises a set of filters that indicate locations of distinct values in each column of the source table. A query directed at the source table is received at the network-based data warehouse. The query is processed using the pruning index. The processing of the query comprises pruning the set of micro-partitions of the source table to scan for data matching the query, the pruning of the plurality of micro-partitions comprising identifying, using the pruning index, a sub-set of micro-partitions to scan for the data matching the query.

    MULTI-LEVEL METADATA IN DATABASE SYSTEMS
    284.
    发明申请

    公开(公告)号:US20200272638A1

    公开(公告)日:2020-08-27

    申请号:US16775092

    申请日:2020-01-28

    Applicant: Snowflake Inc

    Abstract: Systems, methods, and devices for multiple level metadata organization in database systems. A system includes a plurality of shared storage devices collectively storing database data across a plurality of tables that each comprise one or more micro-partitions including immutable storage devices. The system includes a resource manager configured to manage the storage of database data stored in a table across one or more of the plurality of shared storage devices. The resource manager is configured to manage the storage of metadata for the table. The metadata includes a column expression property with information about data stored in a column, a micro-partition expression property with information about data stored in a micro-partition, a grouping expression property with information about data stored in two or more micro-partitions, and cumulative table metadata with global information about all micro-partitions of the table.

    STORING MULTI-LEVEL METADATA IN DATABASE SYSTEMS

    公开(公告)号:US20200272628A1

    公开(公告)日:2020-08-27

    申请号:US16863831

    申请日:2020-04-30

    Applicant: Snowflake Inc.

    Abstract: The subject technology receives first metadata corresponding to a set of micro-partitions. The subject technology generates second metadata for a grouping of the first metadata. The subject technology generates a first data structure including the first metadata and a second data structure including the second metadata, the second data structure including information associating the second metadata to the first metadata. The subject technology stores the first data structure and the second data structure in persistent storage as a first file and a second file. The subject technology receives a query on a table. Further, the subject technology analyzes the query against cumulative table metadata to determine whether data stored in the table matches the query.

    SYSTEMS, METHODS, AND DEVICES FOR SECURELY MANAGING NETWORK CONNECTIONS

    公开(公告)号:US20200259869A1

    公开(公告)日:2020-08-13

    申请号:US16857174

    申请日:2020-04-23

    Applicant: Snowflake Inc.

    Abstract: The disclosure relates generally to methods, systems, and apparatuses for managing network connections. A system for managing network connections includes a storage component, a decoding component, a rule manager component, and a notification component. The storage component is configured to store a list of expected connections for a plurality of networked machines, wherein each connection in the list of expected connections defines a start point and an end point for the connection. The decoding component is configured to decode messages from the plurality of networked machines indicating one or more connections for a corresponding machine. The rule manager component is configured to identify an unexpected presence or absence of a connection on at least one of the plurality of network machines based on the list of expected connections. The notification component is configured to provide a notification or indication of the unexpected presence or absence.

    DATA PRUNING BASED ON METADATA
    289.
    发明申请

    公开(公告)号:US20200257658A1

    公开(公告)日:2020-08-13

    申请号:US16861516

    申请日:2020-04-29

    Applicant: Snowflake Inc.

    Abstract: A system and method for pruning data based on metadata. The method may include receiving a query comprising a plurality of predicates and identifying one or more applicable files comprising database data satisfying at least one of the plurality of predicates. The identifying the one or more applicable files including reading metadata stored in a metadata store that is separate from the database data. The method further includes pruning inapplicable files comprising database data that does not satisfy at least one of the plurality of predicates to create a reduced set of files and reading the reduced set of files to execute the query.

    SECURE DATA SHARING IN A MULTI-TENANT DATABASE SYSTEM

    公开(公告)号:US20200226281A1

    公开(公告)日:2020-07-16

    申请号:US16836521

    申请日:2020-03-31

    Applicant: Snowflake Inc.

    Abstract: Systems, methods, and devices for implementing secure views for zero-copy data sharing in a multi-tenant database system are disclosed. A method includes generating a share object in a first account comprising a share role. The method includes associating view privileges for the share object such that an underlying detail of the share object comprises a secure view definition. The method includes granting, to a second account, cross-account access rights to the share role or share object in the first account. The method includes receiving a request from the second account to access data or services of the first account and providing a response to the second account based on the data or services of the first account. The method is such that the underlying detail of the share object that comprises the secure view definition is hidden from the second account and visible to the first account.

Patent Agency Ranking