-
公开(公告)号:US11347735B2
公开(公告)日:2022-05-31
申请号:US16889033
申请日:2020-06-01
Applicant: Snowflake Inc.
Inventor: Thierry Cruanes , Igor Demura , Varun Ganesh , Prasanna Rajaperumal , Libo Wang , Jiaqi Yan
IPC: G06F16/2453
Abstract: Embodiments of the present disclosure may provide a dynamic query execution model. This query execution model may provide acceleration by scaling out parallel parts of a query (also referred to as a fragment) to additional computing resources, for example computing resources leased from a pool of computing resources. Execution of the parts of the query may be coordinated by a parent query coordinator, where the query originated, and a fragment query coordinator.
-
公开(公告)号:US20210374135A1
公开(公告)日:2021-12-02
申请号:US16889033
申请日:2020-06-01
Applicant: Snowflake Inc.
Inventor: Thierry Cruanes , Igor Demura , Varun Ganesh , Prasanna Rajaperumal , Libo Wang , Jiaqi Yan
IPC: G06F16/2453
Abstract: Embodiments of the present disclosure may provide a dynamic query execution model. This query execution model may provide acceleration by scaling out parallel parts of a query (also referred to as a fragment) to additional computing resources, for example computing resources leased from a pool of computing resources. Execution of the parts of the query may be coordinated by a parent query coordinator, where the query originated, and a fragment query coordinator.
-
公开(公告)号:US11163768B1
公开(公告)日:2021-11-02
申请号:US16889042
申请日:2020-06-01
Applicant: Snowflake Inc.
Inventor: Thierry Cruanes , Igor Demura , Varun Ganesh , Prasanna Rajaperumal , Libo Wang , Jiaqi Yan
IPC: G06F16/2453 , G06F9/48 , G06F16/14 , G06F16/16 , G06F16/11
Abstract: Embodiments of the present disclosure may provide a dynamic query execution model with fault tolerance and failure recovery techniques. Embodiments of the present disclosure may utilize checkpoints to map processed output files to their corresponding input files. Therefore, if an error occurs in processing one or more files, the system may only need to reschedule processing of selected file(s).
-
公开(公告)号:US12106149B2
公开(公告)日:2024-10-01
申请号:US18140086
申请日:2023-04-27
Applicant: Snowflake Inc.
Inventor: Thierry Cruanes , Igor Demura , Varun Ganesh , Prasanna Rajaperumal , Libo Wang , Jiaqi Yan
IPC: G06F9/46 , G06F9/50 , G06F9/54 , H04L67/1001
CPC classification number: G06F9/5027 , G06F9/5077 , G06F9/5083 , G06F9/542 , H04L67/1001 , G06F2209/5011
Abstract: Embodiments of the present disclosure may provide dynamic and fair assignment techniques for allocating resources on a demand basis. Assignment control may be separated into at least two components: a local component and a global component. Each component may have an active dialog with each other; the dialog may include two aspects: 1) a demand for computing resources, and 2) a total allowed number of computing resources. The global component may allocate resources from a pool of resources to different local components, and the local components in turn may assign their allocated resources to local competing requests. The allocation may also be throttled or limited at various levels.
-
公开(公告)号:US12019632B2
公开(公告)日:2024-06-25
申请号:US17930165
申请日:2022-09-07
Applicant: Snowflake Inc.
Inventor: Thierry Cruanes , Igor Demura , Varun Ganesh , Prasanna Rajaperumal , Libo Wang , Jiaqi Yan
CPC classification number: G06F16/24542 , G06F9/485 , G06F16/122 , G06F16/148 , G06F16/162 , G06F16/24539
Abstract: Embodiments of the present disclosure may provide a dynamic query execution model with fault tolerance and failure recovery techniques. Embodiments of the present disclosure may utilize checkpoints to map processed output files to their corresponding input files. Therefore, if an error occurs in processing one or more files, the system may only need to reschedule processing of selected file(s).
-
公开(公告)号:US11822582B2
公开(公告)日:2023-11-21
申请号:US17896446
申请日:2022-08-26
Applicant: SNOWFLAKE INC.
Inventor: Yi Fang , Varun Ganesh , Xinglian Liu , Ryan Michael Thomas Shelly , Jiaqi Yan , Yizhi Zhu
IPC: G06F16/28
CPC classification number: G06F16/285
Abstract: Embodiments of the present disclosure describe systems, methods, and computer program products for improving query processing of a database. An example method can include: storing table data for a table in a plurality of micro-partitions, each micro-partition comprising a portion of the table data for the table; for each micro-partition of the plurality of micro-partitions, storing metadata for the micro-partition in at least one of a plurality of expression properties; and selecting, by a processing device, a subset of the plurality of expression properties to be grouped into a grouping expression property based at least partially on the metadata of the subset of the plurality of the expression properties. The grouping expression property may include cumulative metadata associated with the metadata of the subset of the plurality of expression properties.
-
公开(公告)号:US11809428B2
公开(公告)日:2023-11-07
申请号:US17823572
申请日:2022-08-31
Applicant: Snowflake Inc.
Inventor: Thierry Cruanes , Igor Demura , Varun Ganesh , Prasanna Rajaperumal , Libo Wang , Jiaqi Yan
IPC: G06F16/2453
CPC classification number: G06F16/24542 , G06F16/24537 , G06F16/24539
Abstract: Embodiments of the present disclosure may provide a dynamic query execution model. This query execution model may provide acceleration by scaling out parallel parts of a query (also referred to as a fragment) to additional computing resources, for example computing resources leased from a pool of computing resources. Execution of the parts of the query may be coordinated by a parent query coordinator, where the query originated, and a fragment query coordinator.
-
公开(公告)号:US20230028008A1
公开(公告)日:2023-01-26
申请号:US17930165
申请日:2022-09-07
Applicant: Snowflake Inc.
Inventor: Thierry Cruanes , Igor Demura , Varun Ganesh , Prasanna Rajaperumal , Libo Wang , Jiaqi Yan
IPC: G06F16/2453 , G06F9/48 , G06F16/14 , G06F16/16 , G06F16/11
Abstract: Embodiments of the present disclosure may provide a dynamic query execution model with fault tolerance and failure recovery techniques. Embodiments of the present disclosure may utilize checkpoints to map processed output files to their corresponding input files. Therefore, if an error occurs in processing one or more files, the system may only need to reschedule processing of selected file(s).
-
公开(公告)号:US11461325B2
公开(公告)日:2022-10-04
申请号:US17333358
申请日:2021-05-28
Applicant: Snowflake Inc.
Inventor: Thierry Cruanes , Igor Demura , Varun Ganesh , Prasanna Rajaperumal , Libo Wang , Jiaqi Yan
Abstract: Embodiments of the present disclosure may provide a dynamic query execution model with fault tolerance and failure recovery techniques. Embodiments of the present disclosure may utilize checkpoints to map processed output files to their corresponding input files. Therefore, if an error occurs in processing one or more files, the system may only need to reschedule processing of selected file(s).
-
公开(公告)号:US20240078135A1
公开(公告)日:2024-03-07
申请号:US18140086
申请日:2023-04-27
Applicant: Snowflake Inc.
Inventor: Thierry Cruanes , Igor Demura , Varun Ganesh , Prasanna Rajaperumal , Libo Wang , Jiaqi Yan
IPC: G06F9/50 , G06F9/54 , H04L67/1001
CPC classification number: G06F9/5027 , G06F9/5077 , G06F9/5083 , G06F9/542 , H04L67/1001 , G06F2209/5011
Abstract: Embodiments of the present disclosure may provide dynamic and fair assignment techniques for allocating resources on a demand basis. Assignment control may be separated into at least two components: a local component and a global component. Each component may have an active dialog with each other; the dialog may include two aspects: 1) a demand for computing resources, and 2) a total allowed number of computing resources. The global component may allocate resources from a pool of resources to different local components, and the local components in turn may assign their allocated resources to local competing requests. The allocation may also be throttled or limited at various levels.
-
-
-
-
-
-
-
-
-