公开(公告)号：US20230315693A1

公开(公告)日：2023-10-05

申请号：US17657229

申请日：2022-03-30

Applicant: Snowflake Inc.

Inventor： Selcuk Aya ,  Ju-yi Kuo ,  Jonathan Lee Leang ,  Nitya Kumar Sharma ,  Igor Zinkovsky

IPC: G06F16/176 ,  G06F16/172 ,  G06F16/17

CPC classification number: G06F16/1774 ,  G06F16/172 ,  G06F16/1734

Abstract: Systems and methods for caching file system collections atomically. The systems and methods perform operations comprising: receiving a request to access a collection of data comprising a plurality of files stored on a storage device; in response to receiving the request, transferring the collection of data from the storage device to a first subfolder in a cache associated with the storage device; generating a lock file comprising a reference to the first subfolder in the cache; and atomically controlling access to the collection of data in the first subfolder and removal of the collection of data in the first subfolder from the cache via the lock file.

公开(公告)号：US11586621B1

公开(公告)日：2023-02-21

申请号：US17586493

申请日：2022-01-27

Applicant: Snowflake Inc.

Inventor： Selcuk Aya ,  Thierry Cruanes ,  Florian Andreas Funke

IPC: G06F16/00 ,  G06F16/2453

Abstract: Multiple execution threads process a query directed to a database organized into a plurality of files. In processing the query, a first thread downloads a file from the plurality of files. The file comprises a set of blocks. A parallel scan of the set of blocks is performed by at least the first thread and a second thread to identify data that matches the query. A response to the query is provided based in part on the parallel scan of the set of blocks.

公开(公告)号：US20210240670A1

公开(公告)日：2021-08-05

申请号：US16779366

申请日：2020-01-31

Applicant: Snowflake Inc

Inventor： Selcuk Aya ,  Bowei Chen ,  Florian Andreas Funke

IPC: G06F16/174 ,  G06F16/22 ,  G06F16/27

Abstract: Data in a micro-partition of a table is stored in a compressed form. In response to a database query on the table comprising a filter, the portion of the data on which the filter operates is decompressed, without decompressing other portions of the data. Using the filter on the decompressed portion of the data, the portions of the data that are responsive to the filter are determined and decompressed. The responsive data is returned in response to the database query. When a query is run on a table that is compressed using dictionary compression, the uncompressed data may be returned along with the dictionary look-up values. The recipient of the data may use the dictionary look-up values for memoization, reducing the amount of computation required to process the returned data.

公开(公告)号：US20250068522A1

公开(公告)日：2025-02-27

申请号：US18948923

申请日：2024-11-15

Applicant: Snowflake Inc.

Inventor： Selcuk Aya ,  Leonid Baraznenok ,  Jaeha Lee ,  Adrian Peter Neumann ,  Ryan Michael Thomas Shelly ,  Zerui Wei ,  Jiaqi Yan

IPC: G06F11/14 ,  G06F11/07 ,  G06F16/215

Abstract: Embodiments of the present disclosure may provide a data protection system that performs identification of errors from queries on a database. The data protection system can further identify corrupted data from additional errors, are difficult to detect, and occur between layers of data in the database system. The data protection system can perform corrections of the error data by rebuilding database data or removing the corrupted data.

公开(公告)号：US12174702B2

公开(公告)日：2024-12-24

申请号：US18104249

申请日：2023-01-31

Applicant: Snowflake Inc.

Inventor： Selcuk Aya ,  Leonid Baraznenok ,  Jaeha Lee ,  Adrian Peter Neumann ,  Ryan Michael Thomas Shelly ,  Zerui Wei ,  Jiaqi Yan

IPC: G06F16/00 ,  G06F11/07 ,  G06F11/14 ,  G06F16/215

Abstract: Embodiments of the present disclosure may provide a data protection system that performs identification of errors from queries on a database. The data protection system can further identify corrupted data from additional errors, are difficult to detect, and occur between layers of data in the database system. The data protection system can perform corrections of the error data by rebuilding database data or removing the corrupted data.

公开(公告)号：US11899646B2

公开(公告)日：2024-02-13

申请号：US18193069

申请日：2023-03-30

Applicant: Snowflake Inc.

Inventor： Selcuk Aya ,  Thierry Cruanes ,  Istvan Cseri ,  Benoit Dageville ,  Marcia Feitel ,  Steven P. Herbert ,  Xinglian Liu ,  James Malone ,  Subramanian Muralidhar ,  Muthunagappan Muthuraman ,  Polita Paulus ,  Marianne Shaw ,  Nileema Shingte ,  Wai Sing Wong ,  Jiaqi Yan

IPC: G06F16/22 ,  G06F16/25 ,  G06F16/23

CPC classification number: G06F16/2282 ,  G06F16/2379 ,  G06F16/258

Abstract: The subject technology receives a command to commit a table in a different table format on an external volume. The subject technology generates a first snapshot of the table on internal storage. The subject technology generates a first list of metadata files on the internal storage. The subject technology generates, based on the first list of metadata files, a first set of metadata files on the internal storage. The subject technology generates a second snapshot of the table on the external volume. The subject technology generates a second list of metadata files on the external volume. The subject technology generates, based on the second list of metadata files, a second set of metadata files on the external volume. The subject technology generates a first set of data files in a different file format on the external volume.

公开(公告)号：US20230401193A1

公开(公告)日：2023-12-14

申请号：US18193069

申请日：2023-03-30

Applicant: Snowflake Inc.

Inventor： Selcuk Aya ,  Thierry Cruanes ,  Istvan Cseri ,  Benoit Dageville ,  Marcia Feitel ,  Steven P. Herbert ,  Xinglian Liu ,  James Malone ,  Subramanian Muralidhar ,  Muthunagappan Muthuraman ,  Polita Paulus ,  Marianne Shaw ,  Nileema Shingte ,  Wai Sing Wong ,  Jiaqi Yan

IPC: G06F16/22 ,  G06F16/23 ,  G06F16/25

CPC classification number: G06F16/2282 ,  G06F16/2379 ,  G06F16/258

Abstract: The subject technology receives a command to commit a table in a different table format on an external volume. The subject technology generates a first snapshot of the table on internal storage. The subject technology generates a first list of metadata files on the internal storage. The subject technology generates, based on the first list of metadata files, a first set of metadata files on the internal storage. The subject technology generates a second snapshot of the table on the external volume. The subject technology generates a second list of metadata files on the external volume. The subject technology generates, based on the second list of metadata files, a second set of metadata files on the external volume. The subject technology generates a first set of data files in a different file format on the external volume.

公开(公告)号：US11593212B1

公开(公告)日：2023-02-28

申请号：US17804700

申请日：2022-05-31

Applicant: Snowflake Inc.

Inventor： Selcuk Aya ,  Leonid Baraznenok ,  Jaeha Lee ,  Adrian Peter Neumann ,  Ryan Michael Thomas Shelly ,  Zerui Wei ,  Jiaqi Yan

IPC: G06F16/00 ,  G06F11/14 ,  G06F11/07 ,  G06F16/215

Abstract: Embodiments of the present disclosure may provide a data protection system that performs identification of errors from queries on a database. The data protection system can further identify corrupted data from additional errors, are difficult to detect, and occur between layers of data in the database system. The data protection system can perform corrections of the error data by rebuilding database data or removing the corrupted data.