Hidden database objects over external data

    公开(公告)号:US12222954B2

    公开(公告)日:2025-02-11

    申请号:US18513140

    申请日:2023-11-17

    Applicant: Snowflake Inc.

    Abstract: The subject technology provides techniques for enabling hidden database objects, which in an example are utilized for testing and verifying new database objects against existing workloads. Hidden database objects are a mechanism for bridging that gap by running user workloads on user data in advance of exposing the feature to users. This mechanism allows placing a database object as a hidden object nested beneath a user's visible object (e.g., table, column, view, and the like). Hidden database objects can be used to verify the functionality, parity, performance, and correctness of new unreleased features.

    Optimized identification of performance regression

    公开(公告)号:US12216628B2

    公开(公告)日:2025-02-04

    申请号:US18470706

    申请日:2023-09-20

    Applicant: SNOWFLAKE INC.

    Abstract: A system to identify optimal cloud resources for executing workloads. The system deduplicates historical client queries based on a workload selection configuration to determine a grouping of historical client queries. The system generates a workload based on at least a portion of the grouping of historical client queries. The system repeatedly executes a test run of the workload using resources of a cloud environment to determine whether there is a performance difference in the test run. The system, in response to determining that there is no performance difference, identifies one or more sets of decreased resources of the cloud environment. The system re-executes the test run using the one or more sets of decreased resources of the cloud environment to determine whether there is a performance difference in the test run that is attributed to the one or more sets of decreased resources of the cloud environment.

    MULTI-PHASE QUERY PLAN CACHING
    3.
    发明申请

    公开(公告)号:US20250021556A1

    公开(公告)日:2025-01-16

    申请号:US18901289

    申请日:2024-09-30

    Applicant: Snowflake Inc.

    Abstract: The subject technology receives a query, the query including a statement for performing the query. The subject technology performs a first lookup operation on a multi-phase cache based on the query. The subject technology performs, in response to a first cache miss of the multi-phase cache, parsing of the statement from the query. The subject technology performs, based on the parsing, a compilation process on the query to generate a compiled query plan, the compilation process determining an optimization and a generalization for the query. The subject technology determines that the compiled query plan is cacheable. The subject technology registers, in response to the compiled query plan being cacheable, a dummy entry in the multi-phase cache.

    MICRO-PARTITION CLUSTERING BASED ON EXPRESSION PROPERTY METADATA

    公开(公告)号:US20240354315A1

    公开(公告)日:2024-10-24

    申请号:US18302234

    申请日:2023-04-18

    Applicant: SNOWFLAKE INC.

    CPC classification number: G06F16/285 G06F16/24556

    Abstract: A method for selecting micro-partitions for a clustering operation includes: storing table data in a plurality of micro-partitions of a storage device, wherein each of the plurality of micro-partitions comprises a portion of the table data, wherein subsets of the plurality of micro-partitions are associated with a respective one of a plurality of expression property (EP) files, and wherein each of the plurality of EP files comprises an EP data region that represents the portions of the table data of the subset of the plurality of micro-partitions associated with the EP file; determining sub-ranges of the table data based on the EP data regions of the plurality of EP files; selecting a subset of the plurality of EP files for a clustering operation based on the sub-ranges of the table data; and performing the clustering operation on the micro-partitions associated with the subset of the EP files.

    USER DEFINED FUNCTION MEMOIZATION
    8.
    发明公开

    公开(公告)号:US20240028591A1

    公开(公告)日:2024-01-25

    申请号:US18477694

    申请日:2023-09-29

    Applicant: Snowflake Inc

    CPC classification number: G06F16/24539 G06F21/53 G06F2221/034

    Abstract: A data platform that implements memoizable functions for database objects. The data platform detects a first execution of a memoizable function and generates a first key based on metadata of one or more database objects operated on by the memoizable function and generates a first result for the memoizable function based on the one or more database objects. The data platform detects a second execution of the memoizable function and generates a second key based on the metadata of the one or more database objects operated on by the memoizable function. When the first key and the second key are equal, the data platform reuses the first result of the memoizable function. When the first key and second key do not match, the data platform generates a second result for the second execution of the memoizable function.

    SHARING MATERIALIZED VIEWS IN MULTIPLE TENANT DATABASE SYSTEMS

    公开(公告)号:US20230418818A1

    公开(公告)日:2023-12-28

    申请号:US18463904

    申请日:2023-09-08

    Applicant: Snowflake Inc.

    CPC classification number: G06F16/24539

    Abstract: Systems, methods, and devices for sharing materialized views in multiple tenant database systems. A method includes defining a materialized view over a source table that is associated with a first account of a multiple tenant database. The method includes defining cross-account access rights to the materialized view to a second account such that that second account can read the materialized view without copying the materialized view. The method includes modifying the source table for the materialized view. The method includes identifying whether the materialized view is stale with respect to the source table by merging the materialized view and the source table.

    PERFORMANCE OPTIMIZATIONS FOR SECURE OBJECTS EVALUATIONS

    公开(公告)号:US20230350893A1

    公开(公告)日:2023-11-02

    申请号:US18172688

    申请日:2023-02-22

    Applicant: Snowflake Inc.

    CPC classification number: G06F16/24544 G06F16/2365

    Abstract: A source table can be provided by a provider account in a data system. A secure view of the source table is provided to one or more consumer accounts, the secure view limiting access to a subset of data in the source table. A plan to execute a command using the secure view may be generated, the plan including a secure view boundary on a subset of operations defining the secure view. The plan may be modified to move a first operation that was outside the secure view boundary to within the secure view boundary to generate a second plan to optimize performance in view of limitations or restrictions placed by the secure view.

Patent Agency Ranking