-
公开(公告)号:US20200327124A1
公开(公告)日:2020-10-15
申请号:US16778954
申请日:2020-01-31
Applicant: Snowflake Inc.
Inventor: Jeffrey Rosen , Abdul Munir , Jiaqi Yan , William Waddington , Prasanna Rajaperumal , Thierry Cruanes
IPC: G06F16/2458 , G06F16/2453 , G06F9/50 , G06F16/2455
Abstract: Resource provisioning systems and methods are described. In an embodiment, a system includes a plurality of shared storage devices collectively storing database data, an execution platform, and a compute service manager. The compute service manager is configured to determine a task to be executed in response to a trigger event and determine a query plan for executing the task, wherein the query plan comprises a plurality of discrete subtasks. The compute service manager is further configured to assign the plurality of discrete subtasks to one or more nodes of a plurality of nodes of the execution platform, determine whether execution of the task is complete, and in response to determining the execution of the task is complete, store a record in the plurality of shared storage devices indicating the task was completed.
-
公开(公告)号:US20200327123A1
公开(公告)日:2020-10-15
申请号:US16380848
申请日:2019-04-10
Applicant: Snowflake Inc.
Inventor: Jeffrey Rosen , Abdul Munir , Jiaqi Yan , William Waddington , Prasanna Rajaperumal , Thierry Cruanes
IPC: G06F16/2458 , G06F16/2453 , G06F16/2455 , G06F9/50
Abstract: Resource provisioning systems and methods are described. In an embodiment, a system includes a plurality of shared storage devices collectively storing database data, an execution platform, and a compute service manager. The compute service manager is configured to determine a task to be executed in response to a trigger event and determine a query plan for executing the task, wherein the query plan comprises a plurality of discrete subtasks. The compute service manager is further configured to assign the plurality of discrete subtasks to one or more nodes of a plurality of nodes of the execution platform, determine whether execution of the task is complete, and in response to determining the execution of the task is complete, store a record in the plurality of shared storage devices indicating the task was completed.
-
公开(公告)号:US12242496B2
公开(公告)日:2025-03-04
申请号:US18151327
申请日:2023-01-06
Applicant: Snowflake Inc.
Inventor: Marco H. Kroll , Mariusz Kwiczala , Prayag Chandran Nirmala , William Waddington , Shijie Xu
IPC: G06F16/25 , G06F9/48 , G06F16/2455
Abstract: The subject technology receives a query, the query comprising a set of query statements. The subject technology determines that a set of resources to be utilized by the query during execution is provided by a slot, the slot comprising an allocation of resources provided by a virtual warehouse. The subject technology performs a first scheduling process for execution of the query using the slot. The subject technology determines that an available slot is provided by the virtual warehouse. The subject technology executes, using the virtual warehouse, the query using the available slot.
-
公开(公告)号:US12135697B2
公开(公告)日:2024-11-05
申请号:US18326929
申请日:2023-05-31
Applicant: Snowflake Inc.
Inventor: Benoit Dageville , Adrian Hamza , Lishi Jiang , William Waddington , Khaled Yagoub , Wumengjian Zhu
Abstract: The subject technology generates, by a compute service manager, a schema hash value for a new schema version associated with a new schema version value, the schema hash value based on determining a sum of hash values of a set of attributes of value columns, the set of attributes comprises a column identifier, and a logical type of a column. The subject technology stores a mapping of the schema hash value to the new schema version value for a table in a metadata database. The subject technology stores a new schema entry based on the schema hash value, the new schema version value, and a new column for the table in the metadata database, the metadata database storing multiple entries for different schema versions, each entry including a particular schema hash value for mapping to a corresponding schema version from the different schema versions.
-
公开(公告)号:US12056114B2
公开(公告)日:2024-08-06
申请号:US18326356
申请日:2023-05-31
Applicant: Snowflake Inc.
Inventor: Chen Luo , Alexander Miller , William Waddington , Zhaohui Zhang
CPC classification number: G06F16/2379 , G06F9/524 , G06F16/2365
Abstract: The subject technology determines that a first visible version of a key is not one of a N number of newest versions of the key based on searching for the key in a regular space to locate the first visible version of the key. The subject technology performs a search of an undo space to locate a second visible version of the key. The subject technology determines whether the first visible version or the second visible version of the key is newer. The subject technology provides a newer version of the key between the first visible version and the second visible version of the key.
-
公开(公告)号:US20240232213A1
公开(公告)日:2024-07-11
申请号:US18151327
申请日:2023-01-06
Applicant: Snowflake Inc.
Inventor: Marco H. Kroll et al. , Mariusz Kwiczala , Prayag Chandran Nirmala , William Waddington , Shijie Xu
IPC: G06F16/25 , G06F9/48 , G06F16/2455
CPC classification number: G06F16/254 , G06F9/4881 , G06F16/2455
Abstract: The subject technology receives a query, the query comprising a set of query statements. The subject technology determines that a set of resources to be utilized by the query during execution is provided by a slot, the slot comprising an allocation of resources provided by a virtual warehouse. The subject technology performs a first scheduling process for execution of the query using the slot. The subject technology determines that an available slot is provided by the virtual warehouse. The subject technology executes, using the virtual warehouse, the query using the available slot.
-
公开(公告)号:US12026160B2
公开(公告)日:2024-07-02
申请号:US18300778
申请日:2023-04-14
Applicant: Snowflake Inc.
Inventor: Thierry Cruanes , Xuelai Cui , Sangyong Hwang , Allison Waingold Lee , Boyung Lee , Nicola Dan Onose , William Waddington , Jiaqi Yan , Li Yan , Yongsik Yoon
IPC: G06F16/2453
CPC classification number: G06F16/24542 , G06F16/24539
Abstract: The subject technology receives a query, the query including a set of statements for performing the query. The subject technology populates a compilation context based at least in part the query. The subject technology invokes a compiler to perform a compilation process based on the compilation context. The subject technology performs a lookup operation on a stored plan cache for an exact match based on information from the compilation context. The subject technology, in response to determining an exact match, determines whether the particular query plan requires re-compilation based on a data dependent optimization. The subject technology determines whether a plan cache entry corresponding to the particular query plan includes a data property constraint. The subject technology determines whether the data property constraint still holds based on a set of data properties.
-
公开(公告)号:US20240020298A1
公开(公告)日:2024-01-18
申请号:US18477834
申请日:2023-09-29
Applicant: Snowflake Inc.
Inventor: Khaled Yagoub , Wumengjian Zhu , Benoit Dageville , William Waddington
CPC classification number: G06F16/2379 , G06F16/283 , G06F11/1458 , G06F16/221
Abstract: The subject technology serializes, by at least one hardware processor, non-primary key data of column-organized data into compressed serialized value data that is in a row-organized sequence, the compressed serialized value data compressed using at least one bitmap, the non-primary key data comprising a schema identifier, the column-organized data being stored in a columnar database system, the column-organized data comprising primary key data and the non-primary key data. The subject technology stores the compressed serialized value data in a key-value data store of a key-value database system, the key-value database system processing key-value data in a key-value format. The subject technology receives a query by the columnar database system. The subject technology deserializes a portion of the compressed serialized value data that corresponds to the query. The subject technology processes the query using the columnar database system.
-
公开(公告)号:US20230325386A1
公开(公告)日:2023-10-12
申请号:US18300778
申请日:2023-04-14
Applicant: Snowflake Inc.
Inventor: Thierry Cruanes , Xuelai Cui , Sangyong Hwang , Allison Waingold Lee , Boyung Lee , Nicola Dan Onose , William Waddington , Jiaqi Yan , Li Yan , Yongsik Yoon
IPC: G06F16/2453
CPC classification number: G06F16/24542 , G06F16/24539
Abstract: The subject technology receives a query, the query including a set of statements for performing the query. The subject technology populates a compilation context based at least in part the query. The subject technology invokes a compiler to perform a compilation process based on the compilation context. The subject technology performs a lookup operation on a stored plan cache for an exact match based on information from the compilation context. The subject technology, in response to determining an exact match, determines whether the particular query plan requires re-compilation based on a data dependent optimization. The subject technology determines whether a plan cache entry corresponding to the particular query plan includes a data property constraint. The subject technology determines whether the data property constraint still holds based on a set of data properties.
-
公开(公告)号:US20230267130A1
公开(公告)日:2023-08-24
申请号:US18309056
申请日:2023-04-28
Applicant: Snowflake Inc.
Inventor: Leonidas Galanis , Alexander Miller , William Waddington , Khaled Yagoub
IPC: G06F16/25 , G06F16/2452 , G06F16/28 , G06F16/2455 , G06F16/27
CPC classification number: G06F16/258 , G06F16/256 , G06F16/24524 , G06F16/283 , G06F16/24564 , G06F16/27
Abstract: The subject technology receives, by a first set of decoupled compute instances of a distributed database, a plurality of transactional queries against a transactional processing database stored on a first set of decoupled storage instances, at least one of the first set of decoupled compute instances bypassing a compiler of the distributed database to process the plurality of transactional queries using locally cached data. The subject technology receives at least one select query for processing on an aggregated analytical query database of the distributed database. The subject technology generates, by the compiler of the distributed database, a query plan for execution of the at least one select query using a second set of decoupled compute instances. The subject technology generates, by the second set of decoupled compute instances, an aggregated analytical query result dataset for the at least one select query according to the query plan.
-
-
-
-
-
-
-
-
-