Overlap queries on a distributed database

    公开(公告)号:US12008001B2

    公开(公告)日:2024-06-11

    申请号:US17804434

    申请日:2022-05-27

    Applicant: Snowflake Inc.

    CPC classification number: G06F16/24568 G06F16/244 G06F16/2456 G06F16/24564

    Abstract: Systems, methods, and machine-readable storage devices provide for identifying a user dataset on a distributed database. The system includes generating a similarity score dataset that indicates a similarity between the user dataset and a plurality of datasets of other users of the distributed database. The system generates a plurality of overlap queries that are configured to output overlap datasets between the user dataset and one or more of the plurality of datasets. The system further generates a results dataset by applying one or more of the plurality of overlap queries to a joined dataset comprising data from the user dataset and one of the plurality of datasets of other users on the distributed database.

    Handling system-characteristics drift in machine learning applications

    公开(公告)号:US11934927B2

    公开(公告)日:2024-03-19

    申请号:US18087518

    申请日:2022-12-22

    Applicant: SNOWFLAKE INC.

    CPC classification number: G06N20/00 G06F16/24

    Abstract: Systems and methods for managing input and output error of a machine learning (ML) model in a database system are presented herein. A set of test queries is executed on a first version of a database system to generate first test data, wherein the first version of the system comprises a ML model to generate an output corresponding to a function of the database system. An error model is trained based on the first test data and second test data generated based on a previous version of the system. The error model determines an error associated with the ML model between the first and previous versions of the system. The first version of the system is deployed with the error model, which corrects an output or an input of the ML model until sufficient data has been produced by the error model to retrain the ML model.

    Predictive resource allocation for distributed query execution

    公开(公告)号:US11880364B2

    公开(公告)日:2024-01-23

    申请号:US17157233

    申请日:2021-01-25

    Applicant: Snowflake Inc.

    CPC classification number: G06F16/24542 G06F16/2455 G06N20/00

    Abstract: The subject technology receives a query directed to a set of source tables, each source table organized into a set of micro-partitions. The subject technology determines a set of metadata, the set of metadata comprising table metadata, query metadata, and historical data related to the query. The subject technology predicts, using a machine learning model, an indicator of an amount of computing resources for executing the query based at least in part on the set of metadata. The subject technology generates a query plan for executing the query based at least in part on the predicted indicator of the amount of computing resources. The subject technology executes the query based at least in part on the query plan.

    MULTIPLE USER DEFINED FUNCTIONS REGISTRATION
    15.
    发明公开

    公开(公告)号:US20230393816A1

    公开(公告)日:2023-12-07

    申请号:US18362114

    申请日:2023-07-31

    Applicant: Snowflake Inc.

    CPC classification number: G06F8/315 G06F9/543

    Abstract: The subject technology identifies a set of functions included in a set of files corresponding to a library. The subject technology, for each function in the set of functions, registers the function as a user defined function (UDF). The subject technology generates a name for the function based at least in part on a predetermined prefix, wherein the predetermined prefix comprises an alphanumeric string. The subject technology generates, using at least a particular set of input parameters utilized by the function and a particular type of parameter of each input parameter of the particular set of input parameters, a particular set of source code. The subject technology stores information corresponding to the function in a metadata database. The subject technology provides access to the function in a different application.

    OVERLAP QUERIES ON A DISTRIBUTED DATABASE
    16.
    发明公开

    公开(公告)号:US20230385284A1

    公开(公告)日:2023-11-30

    申请号:US17804434

    申请日:2022-05-27

    Applicant: Snowflake Inc.

    CPC classification number: G06F16/24568 G06F16/2456 G06F16/244 G06F16/24564

    Abstract: Systems, methods, and machine-readable storage devices provide for identifying a user dataset on a distributed database. The system includes generating a similarity score dataset that indicates a similarity between the user dataset and a plurality of datasets of other users of the distributed database. The system generates a plurality of overlap queries that are configured to output overlap datasets between the user dataset and one or more of the plurality of datasets. The system further generates a results dataset by applying one or more of the plurality of overlap queries to a joined dataset comprising data from the user dataset and one of the plurality of datasets of other users on the distributed database.

    BROWSER PLUG-IN FOR MARKETPLACE RECOMMENDATIONS

    公开(公告)号:US20250077591A1

    公开(公告)日:2025-03-06

    申请号:US18238986

    申请日:2023-08-28

    Applicant: Snowflake Inc.

    Abstract: A data access event may be recognized, using a browser plug-in, wherein the data access event constitutes a reference to previously obtained data. As a result of recognizing the event, the plug-in may send, to a search engine of a data exchange, a set of extracted terms. The plug-in may receive a set of related data listings related to the set of extracted terms. Upon a selection of a data listing from the set of related data listings, the plug-in may install the data listing to an account.

    QUERY-EXECUTION PLANNING USING REINFORCEMENT LEARNING

    公开(公告)号:US20250021558A1

    公开(公告)日:2025-01-16

    申请号:US18902195

    申请日:2024-09-30

    Applicant: Snowflake Inc.

    Abstract: A method for improving query scheduling on a computing cluster using reinforcement learning is provided. A series of queries to be executed using resources of the computing cluster is received. For each query, a query execution plan is generated and a resource profile for executing the query is predicted. Current state data of the cluster resources is received and assignment data to execute the query on the cluster resources is generated by applying the reinforcement learning technique. The query is executed on the computing cluster based on the generated assignment data, and query results are stored.

    Software bugs detection using query analysis

    公开(公告)号:US11947533B2

    公开(公告)日:2024-04-02

    申请号:US18318293

    申请日:2023-05-16

    Applicant: Snowflake Inc.

    Inventor: Orestis Kostakis

    CPC classification number: G06F16/245 G06F11/362

    Abstract: A method includes parsing, by at least one hardware processor, a query to determine query comments and query code associated with the query. A query execution plan is generated based on the query code. Query execution using the query code is performed at a first computing node associated with a query processing pipeline. A detection is made that the query comments are indicative of a software bug in the query code based on analysis of the query comments. The detection is performed at a second computing node associated with a query analysis pipeline. A notification of the software bug and a result of the query execution is output.

    AUTOMATED MACHINE LEARNING FOR NETWORK-BASED DATABASE SYSTEMS

    公开(公告)号:US20240062098A1

    公开(公告)日:2024-02-22

    申请号:US17821587

    申请日:2022-08-23

    Applicant: Snowflake Inc.

    CPC classification number: G06N20/00

    Abstract: The subject technology receives first party training data provided by an end-user of a baseline machine learning model. The subject technology determines a first set of common features based on the first party training data. The subject technology receives, from at least one data source. The subject technology determines a second set of common features based on the set of datasets. The subject technology trains, using the first set of common features and the second set of common features, a second machine learning model, the second machine learning model incorporating additional training data from the external data supplier during training compared to the baseline machine learning model. The subject technology generates a boosted machine learning model based at least in part on the training, the boosted machine learning model comprising the trained second machine learning model.

Patent Agency Ranking