公开(公告)号：US20230055715A1

公开(公告)日：2023-02-23

申请号：US17463353

申请日：2021-08-31

Applicant: Snowflake Inc.

Inventor： Chen Luo ,  Alexander Miller ,  William Waddington ,  Zhaohui Zhang

IPC: G06F16/27 ,  G06F16/23

Abstract: A distributed database compaction system can perform compaction for transactional queries in an asynchronous matter without affecting completion of the queries. The compaction system can implement asynchronous transformation of key pairs in the database, and older keys can be periodically purged using a scheduled compactor. Subsequent queries use the compacted stored keys to perform efficient queries with direct reads of committed transactions and more efficient access to key values stores of the distributed database.

公开(公告)号：US20220092050A1

公开(公告)日：2022-03-24

申请号：US17454368

申请日：2021-11-10

Applicant: Snowflake Inc.

Inventor： Chen Luo ,  Alexander Miller ,  William Waddington ,  Zhaohui Zhang

IPC: G06F16/23

Abstract: The subject technology inserts, by a first transaction, a new version of an object, the inserting corresponding to a first statement from the first transaction, the first statement including information indicating a first key, a first transaction identifier, a first statement number, and a first restart count. The subject technology performs, by a second transaction, a range read, the range read including information indicating the first key. The subject technology receives, after performing the range read, a set of conflicting transactions. The subject technology determines that a conflict occurred between the first transaction and a third transaction from the set of conflicting transactions.

公开(公告)号：US11243820B1

公开(公告)日：2022-02-08

申请号：US17334946

申请日：2021-05-31

Applicant: Snowflake Inc.

Inventor： Chen Luo ,  Alexander Miller ,  William Waddington

IPC: G06F9/52 ,  G06F16/23 ,  G06F16/25

Abstract: The subject technology performs a locking operation on a first set of keys by a first statement of a first transaction. The subject technology determines that a conflict occurred between the first statement and a second transaction. The subject technology determines that the second transaction has yet to complete after a predetermined period of time. The subject technology performs a deadlock detection process where the subject technology stores a key and value in a table indicating the first transaction and the second transaction, detects, based at least in part on a graph traversal of the table starting from the first transaction, a cycle between the first transaction and the second transaction, and determines that the first transaction is a youngest transaction in the detected cycle. The subject technology ceases execution of the first transaction in response to the first transaction being a youngest transaction in a detected cycle.

公开(公告)号：US12235833B2

公开(公告)日：2025-02-25

申请号：US18415826

申请日：2024-01-18

Applicant: Snowflake Inc.

Inventor： Thierry Cruanes ,  Moritz Eyssen ,  Max Heimel ,  Lishi Jiang ,  Alexander Miller

IPC: G06F16/23 ,  G06F9/46 ,  G06F9/52 ,  G06F16/2455

Abstract: The subject technology receives, at a first execution node, a first transaction, the first transaction to be executed on linearizable storage. The subject technology determines whether the first execution node corresponds to a rank indicating a leader worker. The subject technology, in response to the first execution node corresponding to the rank indicating the leader worker, performs, by the first execution node, an initialization process for executing the first transaction. The subject technology broadcasts a first read timestamp associated with the first transaction to a set of execution nodes, the set of execution nodes being different than the first execution node. The subject technology executes, by the first execution node, at least a first operation from the first transaction.

公开(公告)号：US20240394263A1

公开(公告)日：2024-11-28

申请号：US18324669

申请日：2023-05-26

Applicant: Snowflake Inc.

Inventor： Cristian Diaconu ,  Chen Luo ,  Alexander Miller

IPC: G06F16/2457 ,  G06F16/215 ,  G06F16/22

Abstract: The subject technology initializes a statement for execution. The subject technology determines that the statement has been executing for longer than a minimum statement timeout. The subject technology periodically updates a read timestamp table with a new update timestamp for an entry corresponding to the statement. The subject technology determines whether the entry corresponding to the statement has been removed from the read timestamp table. The subject technology, in response to determining that the entry has not been removed from the read timestamp table, removes the entry from the read timestamp table. The subject technology provides a set of results from completing execution of the statement.

公开(公告)号：US12056114B2

公开(公告)日：2024-08-06

申请号：US18326356

申请日：2023-05-31

Applicant: Snowflake Inc.

Inventor： Chen Luo ,  Alexander Miller ,  William Waddington ,  Zhaohui Zhang

IPC: G06F16/23 ,  G06F9/52 ,  G06F16/21 ,  G06F16/25

CPC classification number: G06F16/2379 ,  G06F9/524 ,  G06F16/2365

Abstract: The subject technology determines that a first visible version of a key is not one of a N number of newest versions of the key based on searching for the key in a regular space to locate the first visible version of the key. The subject technology performs a search of an undo space to locate a second visible version of the key. The subject technology determines whether the first visible version or the second visible version of the key is newer. The subject technology provides a newer version of the key between the first visible version and the second visible version of the key.

公开(公告)号：US20240232173A1

公开(公告)日：2024-07-11

申请号：US18415826

申请日：2024-01-18

Applicant: Snowflake Inc.

Inventor： Thierry Cruanes ,  Moritz Eyssen ,  Max Heimel ,  Lishi Jiang ,  Alexander Miller

IPC: G06F16/23 ,  G06F16/2455

CPC classification number: G06F16/2379 ,  G06F16/24568

Abstract: The subject technology receives, at a first execution node, a first transaction, the first transaction to be executed on linearizable storage. The subject technology determines whether the first execution node corresponds to a rank indicating a leader worker. The subject technology, in response to the first execution node corresponding to the rank indicating the leader worker, performs, by the first execution node, an initialization process for executing the first transaction. The subject technology broadcasts a first read timestamp associated with the first transaction to a set of execution nodes, the set of execution nodes being different than the first execution node. The subject technology executes, by the first execution node, at least a first operation from the first transaction.

公开(公告)号：US20230267130A1

公开(公告)日：2023-08-24

申请号：US18309056

申请日：2023-04-28

Applicant: Snowflake Inc.

Inventor： Leonidas Galanis ,  Alexander Miller ,  William Waddington ,  Khaled Yagoub

IPC: G06F16/25 ,  G06F16/2452 ,  G06F16/28 ,  G06F16/2455 ,  G06F16/27

CPC classification number: G06F16/258 ,  G06F16/256 ,  G06F16/24524 ,  G06F16/283 ,  G06F16/24564 ,  G06F16/27

Abstract: The subject technology receives, by a first set of decoupled compute instances of a distributed database, a plurality of transactional queries against a transactional processing database stored on a first set of decoupled storage instances, at least one of the first set of decoupled compute instances bypassing a compiler of the distributed database to process the plurality of transactional queries using locally cached data. The subject technology receives at least one select query for processing on an aggregated analytical query database of the distributed database. The subject technology generates, by the compiler of the distributed database, a query plan for execution of the at least one select query using a second set of decoupled compute instances. The subject technology generates, by the second set of decoupled compute instances, an aggregated analytical query result dataset for the at least one select query according to the query plan.

公开(公告)号：US20230244655A1

公开(公告)日：2023-08-03

申请号：US17649737

申请日：2022-02-02

Applicant: Snowflake Inc.

Inventor： Chen Luo ,  Alexander Miller ,  William Waddington ,  Zhaohui Zhang

IPC: G06F16/23 ,  G06F9/52

CPC classification number: G06F16/2379 ,  G06F16/2365 ,  G06F9/524

Abstract: The subject technology performs a search for a key in a regular space to locate a first visible version of the key. The subject technology determines that the first visible version of the key is not one of a N number of newest versions of the key. The subject technology performs a search of an undo space to locate a second visible version of the key. The subject technology determines whether the first visible version or the second visible version of the key is newer. The subject technology provides a newer version of the key between the first visible version and the second visible version of the key.

公开(公告)号：US11709866B2

公开(公告)日：2023-07-25

申请号：US17463353

申请日：2021-08-31

Applicant: Snowflake Inc.

Inventor： Chen Luo ,  Alexander Miller ,  William Waddington ,  Zhaohui Zhang

IPC: G06F16/27 ,  G06F16/23

CPC classification number: G06F16/273 ,  G06F16/2343 ,  G06F16/2379

Abstract: A distributed database compaction system can perform compaction for transactional queries in an asynchronous matter without affecting completion of the queries. The compaction system can implement asynchronous transformation of key pairs in the database, and older keys can be periodically purged using a scheduled compactor. Subsequent queries use the compacted stored keys to perform efficient queries with direct reads of committed transactions and more efficient access to key values stores of the distributed database.