-
公开(公告)号:US12222954B2
公开(公告)日:2025-02-11
申请号:US18513140
申请日:2023-11-17
Applicant: Snowflake Inc.
Inventor: Kavinder S. Dhaliwal , Bicheng Gao , Valeri Kim , Nithin Mahesh , Jiaqi Yan , Jiaqi Zhang
IPC: G06F16/25 , G06F16/22 , G06F16/245
Abstract: The subject technology provides techniques for enabling hidden database objects, which in an example are utilized for testing and verifying new database objects against existing workloads. Hidden database objects are a mechanism for bridging that gap by running user workloads on user data in advance of exposing the feature to users. This mechanism allows placing a database object as a hidden object nested beneath a user's visible object (e.g., table, column, view, and the like). Hidden database objects can be used to verify the functionality, parity, performance, and correctness of new unreleased features.
-
公开(公告)号:US12216628B2
公开(公告)日:2025-02-04
申请号:US18470706
申请日:2023-09-20
Applicant: SNOWFLAKE INC.
Inventor: Allison Lee , Shrainik Jain , Qiuye Jin , Stratis Viglas , Jiaqi Yan
IPC: G06F16/00 , G06F11/07 , G06F11/30 , G06F11/34 , G06F16/21 , G06F16/215 , G06F16/2453
Abstract: A system to identify optimal cloud resources for executing workloads. The system deduplicates historical client queries based on a workload selection configuration to determine a grouping of historical client queries. The system generates a workload based on at least a portion of the grouping of historical client queries. The system repeatedly executes a test run of the workload using resources of a cloud environment to determine whether there is a performance difference in the test run. The system, in response to determining that there is no performance difference, identifies one or more sets of decreased resources of the cloud environment. The system re-executes the test run using the one or more sets of decreased resources of the cloud environment to determine whether there is a performance difference in the test run that is attributed to the one or more sets of decreased resources of the cloud environment.
-
公开(公告)号:US20250021556A1
公开(公告)日:2025-01-16
申请号:US18901289
申请日:2024-09-30
Applicant: Snowflake Inc.
Inventor: Xuelai Cui , Prashant Gaharwar , Vineet Garg , Boyung Lee , Kevin Ye Jie Li , Nicola Dan Onose , Andrew Z. Xue , Jiaqi Yan
IPC: G06F16/2453 , G06F11/34 , G06F16/2452
Abstract: The subject technology receives a query, the query including a statement for performing the query. The subject technology performs a first lookup operation on a multi-phase cache based on the query. The subject technology performs, in response to a first cache miss of the multi-phase cache, parsing of the statement from the query. The subject technology performs, based on the parsing, a compilation process on the query to generate a compiled query plan, the compilation process determining an optimization and a generalization for the query. The subject technology determines that the compiled query plan is cacheable. The subject technology registers, in response to the compiled query plan being cacheable, a dummy entry in the multi-phase cache.
-
公开(公告)号:US12169490B2
公开(公告)日:2024-12-17
申请号:US18175007
申请日:2023-02-27
Applicant: Snowflake Inc.
Inventor: Varun Ganesh , Saiyang Gou , Prasanna Rajaperumal , Wenhao Song , Libo Wang , Jiaqi Yan
IPC: G06F16/00 , G06F16/22 , G06F16/2453 , G06F16/2455 , G06F16/28
Abstract: Methods, systems, and computer programs are presented for providing a cluster view method of a database to perform compaction and clustering of database objects, such as database materialized view. A cluster view system identifies a materialized view including data from one or more base tables, a portion of the data of the materialized view including stale data. The cluster view system performs an integrated task within a maintenance operation on a database, the integrated task including compacting the materialized view, the maintenance operation including clustering the materialized view, and stores the compacted and clustered materialized view in the database.
-
公开(公告)号:US20240354315A1
公开(公告)日:2024-10-24
申请号:US18302234
申请日:2023-04-18
Applicant: SNOWFLAKE INC.
Inventor: Varun Ganesh , Alvin E. Jou , Donghe Kang , Ryan Michael Thomas Shelly , Jiaqi Yan , Yizhi Zhu
IPC: G06F16/28 , G06F16/2455
CPC classification number: G06F16/285 , G06F16/24556
Abstract: A method for selecting micro-partitions for a clustering operation includes: storing table data in a plurality of micro-partitions of a storage device, wherein each of the plurality of micro-partitions comprises a portion of the table data, wherein subsets of the plurality of micro-partitions are associated with a respective one of a plurality of expression property (EP) files, and wherein each of the plurality of EP files comprises an EP data region that represents the portions of the table data of the subset of the plurality of micro-partitions associated with the EP file; determining sub-ranges of the table data based on the EP data regions of the plurality of EP files; selecting a subset of the plurality of EP files for a clustering operation based on the sub-ranges of the table data; and performing the clustering operation on the micro-partitions associated with the subset of the EP files.
-
公开(公告)号:US20240320202A1
公开(公告)日:2024-09-26
申请号:US18678357
申请日:2024-05-30
Applicant: Snowflake Inc.
Inventor: Vlad Bunescu , Joshua Klahr , Louis Magarshack , Shiyu Qu , Zerui Wei , Jiaqi Yan
CPC classification number: G06F16/2228 , G06F16/254
Abstract: Methods, systems, and computer programs are described for tracking evaluation of workload stability through performance indexing. A plurality of metric source data is received by at least one hardware processor. Based on this data, a workload is identified as a stable workload candidate. A performance index is then generated, reflecting the characteristics of the identified stable workload candidate. The performance index is continuously tracked over a period of time, enabling the detection and analysis of any modifications to the workload and the subsequent impact on system performance.
-
公开(公告)号:US12007961B2
公开(公告)日:2024-06-11
申请号:US18345987
申请日:2023-06-30
Applicant: Snowflake Inc.
Inventor: Istvan Cseri , Benoit Dageville , Ganeshan Ramachandran Iyer , Yucan Liu , Jiaqi Yan
CPC classification number: G06F16/211
Abstract: Techniques for schema mismatch detection and evolution are described. When data is being uploaded into a source table, schema of the data to be uploaded can be compared with the schema for the source table. If a schema mismatch is detected, the schema of the source table can be modified, and the upload can be continued without data loss.
-
公开(公告)号:US20240028591A1
公开(公告)日:2024-01-25
申请号:US18477694
申请日:2023-09-29
Applicant: Snowflake Inc
Inventor: Raja Suresh Krishna Balakrishnan , Thierry Cruanes , Yujie Li , Subramanian Muralidhar , David Schultz , Jiaqi Yan
IPC: G06F16/2453 , G06F21/53
CPC classification number: G06F16/24539 , G06F21/53 , G06F2221/034
Abstract: A data platform that implements memoizable functions for database objects. The data platform detects a first execution of a memoizable function and generates a first key based on metadata of one or more database objects operated on by the memoizable function and generates a first result for the memoizable function based on the one or more database objects. The data platform detects a second execution of the memoizable function and generates a second key based on the metadata of the one or more database objects operated on by the memoizable function. When the first key and the second key are equal, the data platform reuses the first result of the memoizable function. When the first key and second key do not match, the data platform generates a second result for the second execution of the memoizable function.
-
公开(公告)号:US20230418818A1
公开(公告)日:2023-12-28
申请号:US18463904
申请日:2023-09-08
Applicant: Snowflake Inc.
Inventor: Prasanna Rajaperumal , Thierry Cruanes , Allison Waingold Lee , Igor Demura , Jiaqi Yan , Benoit Dageville
IPC: G06F16/2453
CPC classification number: G06F16/24539
Abstract: Systems, methods, and devices for sharing materialized views in multiple tenant database systems. A method includes defining a materialized view over a source table that is associated with a first account of a multiple tenant database. The method includes defining cross-account access rights to the materialized view to a second account such that that second account can read the materialized view without copying the materialized view. The method includes modifying the source table for the materialized view. The method includes identifying whether the materialized view is stale with respect to the source table by merging the materialized view and the source table.
-
公开(公告)号:US20230350893A1
公开(公告)日:2023-11-02
申请号:US18172688
申请日:2023-02-22
Applicant: Snowflake Inc.
Inventor: Bicheng Gao , Nicola Dan Onose , Jiaqi Yan
IPC: G06F16/2453 , G06F16/23
CPC classification number: G06F16/24544 , G06F16/2365
Abstract: A source table can be provided by a provider account in a data system. A secure view of the source table is provided to one or more consumer accounts, the secure view limiting access to a subset of data in the source table. A plan to execute a command using the secure view may be generated, the plan including a secure view boundary on a subset of operations defining the secure view. The plan may be modified to move a first operation that was outside the secure view boundary to within the secure view boundary to generate a second plan to optimize performance in view of limitations or restrictions placed by the secure view.
-
-
-
-
-
-
-
-
-