公开(公告)号：US12086154B1

公开(公告)日：2024-09-10

申请号：US18455229

申请日：2023-08-24

Applicant: Snowflake Inc.

Inventor： Mihir Dharamshi ,  Cristian Diaconu ,  Chen Luo ,  Andrew McCormick ,  Corbin McElhanney ,  Joshua Slocum ,  Wumengjian Zhu

IPC: G06F16/25 ,  G06F16/11 ,  G06F16/172 ,  G06F16/23

CPC classification number: G06F16/254 ,  G06F16/116 ,  G06F16/172 ,  G06F16/2379

Abstract: The subject technology receives a query, the query including a query range for processing the query. The subject technology sends a request to a key-value store for blob metadata and a set of recent writes for the query range. The subject technology receives the blob metadata, the blob metadata including information related to a set of blob files. The subject technology determines whether the set of blob files is stored in a local cache. The subject technology, in response to at least one blob file being missing from the set of blob files, sends a request to a blob store to retrieve the at least one blob file of the set of blob files. The subject technology transforms the retrieved at least one blob file to a column file format. The subject technology stores the transformed at least one blob file in the local cache.

公开(公告)号：US20240394244A1

公开(公告)日：2024-11-28

申请号：US18790664

申请日：2024-07-31

Applicant: Snowflake Inc.

Inventor： Cristian Diaconu ,  Nikolaos Romanos Katsipoulakis ,  Alexander Miller ,  Dimitrios Tsirogiannis ,  William Waddington ,  Zhaohui Zhang

IPC: G06F16/23 ,  G06F16/22

Abstract: The subject technology initiates an online index building process of an index of a hybrid table. The subject technology includes, in the index, a new index record for each record from the hybrid table. The subject technology validates the index. The subject technology retrieves a first metadata version of the hybrid table from a metadata database. The subject technology retrieves a second metadata version of the hybrid table from a distributed data store. The subject technology compares the first metadata version with the second metadata version. The subject technology determines that the second metadata version is less than or equal to the first metadata version. The subject technology, in response to successfully validating the index, indicates in a particular entry of the index that validation of the index has succeeded.

公开(公告)号：US20240394263A1

公开(公告)日：2024-11-28

申请号：US18324669

申请日：2023-05-26

Applicant: Snowflake Inc.

Inventor： Cristian Diaconu ,  Chen Luo ,  Alexander Miller

IPC: G06F16/2457 ,  G06F16/215 ,  G06F16/22

Abstract: The subject technology initializes a statement for execution. The subject technology determines that the statement has been executing for longer than a minimum statement timeout. The subject technology periodically updates a read timestamp table with a new update timestamp for an entry corresponding to the statement. The subject technology determines whether the entry corresponding to the statement has been removed from the read timestamp table. The subject technology, in response to determining that the entry has not been removed from the read timestamp table, removes the entry from the read timestamp table. The subject technology provides a set of results from completing execution of the statement.

公开(公告)号：US12135700B1

公开(公告)日：2024-11-05

申请号：US18460206

申请日：2023-09-01

Applicant: Snowflake Inc.

Inventor： Mihir Dharamshi ,  Cristian Diaconu ,  Chen Luo ,  Joshua Slocum

IPC: G06F16/00 ,  G06F16/21 ,  G06F16/22 ,  G06F16/23 ,  G06F16/2453 ,  G06F16/28

Abstract: The subject technology receives a query, the query including a query range for processing the query and a set of requested columns. The subject technology based on the query range, determining a set of blob files and a set of delete vectors. The subject technology for each blob file, storing each row, including the set of request columns, into an array of rowsets. The subject technology for each rowset, generating a delete bitset to at least indicate whether each row has been deleted. The subject technology for each delta file, indicate a previous row of a visible row of the delta file as being deleted based on a delete pointer of the visible row. The subject technology providing a set of rowsets, including a corresponding selection column set, as a result of the query.

公开(公告)号：US12093248B1

公开(公告)日：2024-09-17

申请号：US18313768

申请日：2023-05-08

Applicant: Snowflake Inc.

Inventor： Cristian Diaconu ,  Nikolaos Romanos Katsipoulakis ,  Alexander Miller ,  Dimitrios Tsirogiannis ,  William Waddington ,  Zhaohui Zhang

IPC: G06F16/23 ,  G06F16/22

CPC classification number: G06F16/2379 ,  G06F16/22 ,  G06F16/2365

Abstract: The subject technology receives a statement to initiate an online index building process of an index. The subject technology determines that the index can be generated. The subject technology performs a write operation to store an index record indicating an initial status of the online index building process. The subject technology performs a statement fencing process. The subject technology performs a back-filling process of the index. The subject technology validates the index.

公开(公告)号：US20250068640A1

公开(公告)日：2025-02-27

申请号：US18787807

申请日：2024-07-29

Applicant: Snowflake Inc.

Inventor： Mihir Dharamshi ,  Cristian Diaconu ,  Chen Luo ,  Andrew McCormick ,  Corbin McEihanney ,  Joshua Slocum ,  Wumengjian Zhu

IPC: G06F16/25 ,  G06F16/11 ,  G06F16/172 ,  G06F16/23

Abstract: The subject technology receives, by an execution node, blob metadata from a key-value store, the blob metadata including information related to a set of blob files. The subject technology determines, by the execution node using the blob metadata, whether a copy of each of the set of blob files is stored in a local cache of the execution node. The subject technology transforms at least one blob file, retrieved from a blob store, to a second file in a column file format, the at least one blob file being in a first format that is different than the column file format, the transforming comprising at least converting a particular snapshot file from the at least one blob file to a particular set of rowsets and writing the set of rowsets into the second file in the column file format. The subject technology stores the second file in the local cache.