公开(公告)号：US20250068640A1

公开(公告)日：2025-02-27

申请号：US18787807

申请日：2024-07-29

Applicant: Snowflake Inc.

Inventor： Mihir Dharamshi ,  Cristian Diaconu ,  Chen Luo ,  Andrew McCormick ,  Corbin McEihanney ,  Joshua Slocum ,  Wumengjian Zhu

IPC: G06F16/25 ,  G06F16/11 ,  G06F16/172 ,  G06F16/23

Abstract: The subject technology receives, by an execution node, blob metadata from a key-value store, the blob metadata including information related to a set of blob files. The subject technology determines, by the execution node using the blob metadata, whether a copy of each of the set of blob files is stored in a local cache of the execution node. The subject technology transforms at least one blob file, retrieved from a blob store, to a second file in a column file format, the at least one blob file being in a first format that is different than the column file format, the transforming comprising at least converting a particular snapshot file from the at least one blob file to a particular set of rowsets and writing the set of rowsets into the second file in the column file format. The subject technology stores the second file in the local cache.

公开(公告)号：US12086154B1

公开(公告)日：2024-09-10

申请号：US18455229

申请日：2023-08-24

Applicant: Snowflake Inc.

Inventor： Mihir Dharamshi ,  Cristian Diaconu ,  Chen Luo ,  Andrew McCormick ,  Corbin McElhanney ,  Joshua Slocum ,  Wumengjian Zhu

IPC: G06F16/25 ,  G06F16/11 ,  G06F16/172 ,  G06F16/23

CPC classification number: G06F16/254 ,  G06F16/116 ,  G06F16/172 ,  G06F16/2379

Abstract: The subject technology receives a query, the query including a query range for processing the query. The subject technology sends a request to a key-value store for blob metadata and a set of recent writes for the query range. The subject technology receives the blob metadata, the blob metadata including information related to a set of blob files. The subject technology determines whether the set of blob files is stored in a local cache. The subject technology, in response to at least one blob file being missing from the set of blob files, sends a request to a blob store to retrieve the at least one blob file of the set of blob files. The subject technology transforms the retrieved at least one blob file to a column file format. The subject technology stores the transformed at least one blob file in the local cache.