公开(公告)号：US11615095B2

公开(公告)日：2023-03-28

申请号：US17162979

申请日：2021-01-29

Applicant: Snowflake Inc.

Inventor： Bicheng Gao ,  Srinivas Vemuri ,  Jiaqi Yan

IPC: G06F16/2455 ,  G06F11/34 ,  G06F16/248 ,  G06F16/22 ,  G06F16/2453

Abstract: During a query compilation process, a query is received that is directed to a set of source tables, each source table from the set of source tables being organized into at least one micro-partition and the query including at least one pruning operation. During the query compilation process, a modification of the query is performed for adjusting the at least one pruning operation, the modification being based on a set of statistics collected for previous pruning operations on at least a portion of the set of source tables and a set of heuristics, the set of statistics indicating at least an amount of execution time for each previous query associated with each of the previous pruning operations. The query is compiled including the modification of the query. The compiled query is provided to an execution node of a database system for execution.

公开(公告)号：US11475011B2

公开(公告)日：2022-10-18

申请号：US17540945

申请日：2021-12-02

Applicant: Snowflake Inc.

Inventor： Bicheng Gao ,  Srinivas Vemuri ,  Jiaqi Yan

IPC: G06F16/2455 ,  G06F11/34 ,  G06F16/248 ,  G06F16/22 ,  G06F16/2453

Abstract: The subject technology receives, during a query compilation process, a query directed to a set of source tables, each source table from the set of source tables being organized into at least one micro-partition and the query including at least one pruning operation. The subject technology performs, during the query compilation process, a modification of the query for adjusting the at least one pruning operation, the modification being based at least in part on a set of statistics collected for previous pruning operations on at least a portion of the set of source tables and a set of heuristics. The subject technology compiles the query including the modification of the query. The subject technology provides the compiled query to an execution node of a database system for execution.

公开(公告)号：US20220405285A1

公开(公告)日：2022-12-22

申请号：US17822264

申请日：2022-08-25

Applicant: Snowflake Inc.

Inventor： Bicheng Gao ,  Srinivas Vemuri ,  Jiaqi Yan

IPC: G06F16/2455 ,  G06F11/34 ,  G06F16/248 ,  G06F16/22 ,  G06F16/2453

Abstract: The subject technology receives, during a query compilation process, a query directed to a set of source tables. The subject technology performs, during the query compilation process, a modification of the query for adjusting at least one pruning operation. The subject technology determines, during a pruning process of a second query, the second query directed to a set of files in a database system and including a set of pruning operations on the set of files, whether to perform a pruning cutoff on the set of pruning operations, the pruning process performing a depth first search of a pruner tree structure, the set of files comprising a set of micro-partitions. The subject technology performs the pruning cutoff based on the determining, the pruning cutoff ceasing at least one pruning operation from the set of pruning operations.

公开(公告)号：US20220138202A1

公开(公告)日：2022-05-05

申请号：US17540945

申请日：2021-12-02

Applicant: Snowflake Inc.

Inventor： Bicheng Gao ,  Srinivas Vemuri ,  Jiaqi Yan

IPC: G06F16/2455 ,  G06F11/34 ,  G06F16/248 ,  G06F16/22

Abstract: The subject technology receives, during a query compilation process, a query directed to a set of source tables, each source table from the set of source tables being organized into at least one micro-partition and the query including at least one pruning operation. The subject technology performs, during the query compilation process, a modification of the query for adjusting the at least one pruning operation, the modification being based at least in part on a set of statistics collected for previous pruning operations on at least a portion of the set of source tables and a set of heuristics. The subject technology compiles the query including the modification of the query. The subject technology provides the compiled query to an execution node of a database system for execution.

公开(公告)号：US11755581B2

公开(公告)日：2023-09-12

申请号：US17822264

申请日：2022-08-25

Applicant: Snowflake Inc.

Inventor： Bicheng Gao ,  Srinivas Vemuri ,  Jiaqi Yan

IPC: G06F16/2455 ,  G06F11/34 ,  G06F16/248 ,  G06F16/22 ,  G06F16/2453

CPC classification number: G06F16/24554 ,  G06F11/3409 ,  G06F16/2282 ,  G06F16/248 ,  G06F16/24534

Abstract: The subject technology receives, during a query compilation process, a query directed to a set of source tables. The subject technology performs, during the query compilation process, a modification of the query for adjusting at least one pruning operation. The subject technology determines, during a pruning process of a second query, the second query directed to a set of files in a database system and including a set of pruning operations on the set of files, whether to perform a pruning cutoff on the set of pruning operations, the pruning process performing a depth first search of a pruner tree structure, the set of files comprising a set of micro-partitions. The subject technology performs the pruning cutoff based on the determining, the pruning cutoff ceasing at least one pruning operation from the set of pruning operations.

公开(公告)号：US20220138196A1

公开(公告)日：2022-05-05

申请号：US17162979

申请日：2021-01-29

Applicant: Snowflake Inc.

Inventor： Bicheng Gao ,  Srinivas Vemuri ,  Jiaqi Yan

IPC: G06F16/2453

Abstract: During a query compilation process, a query is received that is directed to a set of source tables, each source table from the set of source tables being organized into at least one micro-partition and the query including at least one pruning operation. During the query compilation process, a modification of the query is performed for adjusting the at least one pruning operation, the modification being based on a set of statistics collected for previous pruning operations on at least a portion of the set of source tables and a set of heuristics, the set of statistics indicating at least an amount of execution time for each previous query associated with each of the previous pruning operations. The query is compiled including the modification of the query. The compiled query is provided to an execution node of a database system for execution.

公开(公告)号：US11222019B1

公开(公告)日：2022-01-11

申请号：US17165194

申请日：2021-02-02

Applicant: Snowflake Inc.

Inventor： Bicheng Gao ,  Srinivas Vemuri ,  Jiaqi Yan

IPC: G06F16/2455 ,  G06F11/34 ,  G06F16/248 ,  G06F16/22

Abstract: The subject technology receives, during a query compilation process, a query directed to a set of source tables, each source table from the set of source tables being organized into at least one micro-partition and the query including at least one pruning operation. The subject technology performs, during the query compilation process, a modification of the query for adjusting the at least one pruning operation, the modification being based at least in part on a set of statistics collected for previous pruning operations on at least a portion of the set of source tables and a set of heuristics. The subject technology compiles the query including the modification of the query. The subject technology provides the compiled query to an execution node of a database system for execution.