公开(公告)号：US20230176909A1

公开(公告)日：2023-06-08

申请号：US18161044

申请日：2023-01-28

Applicant: Snowflake Inc.

Inventor： Johan Harjono ,  Daniel Geoffrey Karp ,  Kunal Prafulla Nabar ,  Rares Radut ,  Arthur Kelvin Shi

IPC: G06F9/50 ,  G06F9/355

CPC classification number: G06F9/5005 ,  G06F9/3555 ,  G06F9/505 ,  G06F9/5077 ,  G06F9/5083

Abstract: Techniques described herein can optimize usage of computing resources in a data system. Dynamic throttling can be performed locally on a computing resource in the foreground and autoscaling can be performed in a centralized fashion in the background. Dynamic throttling can lower the load without overshooting while minimizing oscillation and reducing the throttle quickly. Autoscaling may involve scaling in or out the number of computing resources in a cluster as well as scaling up or down the type of computing resources to handle different types of situations.

公开(公告)号：US20230030636A1

公开(公告)日：2023-02-02

申请号：US17823877

申请日：2022-08-31

Applicant: Snowflake Inc.

Inventor： Ata E. Husain Bohra ,  Daniel Geoffrey Karp

IPC: G06F11/14 ,  G06F9/50 ,  G06F16/25 ,  G06F16/245

Abstract: The subject technology retrieves information related to a set of instances of compute service managers, each instance of a particular compute service manager being associated with a set of virtual warehouses. The subject technology filters the information to determine a set of candidates from the set of instances of compute service managers. The subject technology sorts the set of candidates based at least in part on each workload of each of the set of candidates. The subject technology selects a candidate compute service manager from the set of instances of compute service managers to issue a query restart by randomly selecting an execution node, the execution node being included in a particular virtual warehouse associated with the candidate compute service manager, the selecting facilitating improving utilization of cluster resources and improving query execution on the selected candidate compute service manager.

公开(公告)号：US11347550B1

公开(公告)日：2022-05-31

申请号：US17463376

申请日：2021-08-31

Applicant: Snowflake Inc.

Inventor： Johan Harjono ,  Daniel Geoffrey Karp ,  Kunal Prafulla Nabar ,  Rares Radut ,  Arthur Kelvin Shi

IPC: G06F9/50

Abstract: Techniques described herein can optimize usage of computing resources in a data system. Dynamic throttling can be performed locally on a computing resource in the foreground and autoscaling can be performed in a centralized fashion in the background. Dynamic throttling can lower the load without overshooting while minimizing oscillation and reducing the throttle quickly. Autoscaling may involve scaling in or out the number of computing resources in a cluster as well as scaling up or down the type of computing resources to handle different types of situations.

公开(公告)号：US20250045083A1

公开(公告)日：2025-02-06

申请号：US18362587

申请日：2023-07-31

Applicant: Snowflake Inc.

Inventor： Daniel Geoffrey Karp ,  Themistoklis Melissaris ,  Kunal Prafulla Nabar ,  Samir Rehmtulla

IPC: G06F9/455

Abstract: Provided herein are systems and methods for distributed control plane enablement in a development environment of a database system. A first provisioning request for configuring a control plane environment at a computing node of a database system is decoded. The control plane environment corresponds to a control plane of the database system. A first VM cluster and a second VM cluster are instantiated at the computing node based on the first provisioning request. A cluster manager VM is instantiated within the first VM cluster. The cluster manager VM is configured with at least one control plane management function of the control plane environment. At least one foreground VM is instantiated within the first VM cluster. The at least one foreground VM is configured with at least one query processing function. A query received by the computing node is processed using the at least one query processing function.

公开(公告)号：US20230325362A1

公开(公告)日：2023-10-12

申请号：US18326645

申请日：2023-05-31

Applicant: Snowflake Inc.

Inventor： Johan Harjono ,  Daniel Geoffrey Karp ,  Rares Radut ,  Samir Rehmtulla ,  Arthur Kelvin Shi ,  Thanakul Wattanawong

IPC: G06F16/182 ,  G06F16/28

CPC classification number: G06F16/1824 ,  G06F16/285

Abstract: The subject technology selects a particular zone among multiple zones based on a target skew to meet a global balancing of cluster instances. The subject technology deploys a particular type of cluster instance to the particular zone. The subject technology, for each zone from the multiple zones, determines a respective number of cluster instances. The subject technology identifies a second particular type of cluster instance to add based on a total number of the second particular type of cluster instance in the multiple zones and a second total number of the particular type of cluster instance in the multiple zones. The subject technology adds the second particular type of cluster instance to a second particular zone to meet the global balancing of cluster instances in the multiple zones.

公开(公告)号：US20230305928A1

公开(公告)日：2023-09-28

申请号：US18326471

申请日：2023-05-31

Applicant: Snowflake Inc.

Inventor： Ata E. Husain Bohra ,  Daniel Geoffrey Karp

IPC: G06F11/14 ,  G06F16/245 ,  G06F16/25 ,  G06F9/50

CPC classification number: G06F11/1435 ,  G06F16/245 ,  G06F16/256 ,  G06F9/5038 ,  G06F9/505 ,  G06F9/5022

Abstract: The subject technology selects a candidate compute service manager from a set of instances of compute service managers to issue a query restart by selecting an execution node, the execution node being included in a particular virtual warehouse associated with the candidate compute service manager, the selecting facilitating improving utilization of cluster resources and improving query execution on the selected candidate compute service manager. The subject technology receives a notification indicating that a particular compute service manager has been quiesced. The subject technology determines a set of jobs that are not yet scheduled for execution and eligible for query retry. The subject technology determines a second set of jobs from the set of jobs to send at least another compute service manager for execution. The subject technology sends the second set of jobs to at least another compute service manager for execution.

公开(公告)号：US20220413913A1

公开(公告)日：2022-12-29

申请号：US17463366

申请日：2021-08-31

Applicant: Snowflake Inc.

Inventor： Johan Harjono ,  Daniel Geoffrey Karp ,  Kunal Prafulla Nabar ,  Rares Radut ,  Arthur Kelvin Shi

IPC: G06F9/50

Abstract: Techniques described herein can optimize usage of computing resources in a data system. Dynamic throttling can be performed locally on a computing resource in the foreground and autoscaling can be performed in a centralized fashion in the background. Dynamic throttling can lower the load without overshooting while minimizing oscillation and reducing the throttle quickly. Autoscaling may involve scaling in or out the number of computing resources in a cluster as well as scaling up or down the type of computing resources to handle different types of situations.

公开(公告)号：US20240061709A1

公开(公告)日：2024-02-22

申请号：US18497260

申请日：2023-10-30

Applicant: Snowflake, Inc.

Inventor： Johan Harjono ,  Daniel Geoffrey Karp ,  Kunal Prafulla Nabar ,  Rares Radut ,  Arthur Kelvin Shi

IPC: G06F9/50 ,  G06F9/355

CPC classification number: G06F9/5005 ,  G06F9/3555 ,  G06F9/505 ,  G06F9/5077 ,  G06F9/5083

Abstract: Techniques described herein can optimize usage of computing resources in a data system. Dynamic throttling can be performed locally on a computing resource in the foreground and autoscaling can be performed in a centralized fashion in the background. Dynamic throttling can lower the load without overshooting while minimizing oscillation and reducing the throttle quickly. Autoscaling may involve scaling in or out the number of computing resources in a cluster as well as scaling up or down the type of computing resources to handle different types of situations.

公开(公告)号：US11842215B2

公开(公告)日：2023-12-12

申请号：US18161044

申请日：2023-01-28

Applicant: Snowflake Inc.

Inventor： Johan Harjono ,  Daniel Geoffrey Karp ,  Kunal Prafulla Nabar ,  Rares Radut ,  Arthur Kelvin Shi

IPC: G06F9/50 ,  G06F9/355

CPC classification number: G06F9/5005 ,  G06F9/3555 ,  G06F9/505 ,  G06F9/5077 ,  G06F9/5083

Abstract: Techniques described herein can optimize usage of computing resources in a data system. Dynamic throttling can be performed locally on a computing resource in the foreground and autoscaling can be performed in a centralized fashion in the background. Dynamic throttling can lower the load without overshooting while minimizing oscillation and reducing the throttle quickly. Autoscaling may involve scaling in or out the number of computing resources in a cluster as well as scaling up or down the type of computing resources to handle different types of situations.

公开(公告)号：US11599389B2

公开(公告)日：2023-03-07

申请号：US17463366

申请日：2021-08-31

Applicant: Snowflake Inc.

Inventor： Johan Harjono ,  Daniel Geoffrey Karp ,  Kunal Prafulla Nabar ,  Rares Radut ,  Arthur Kelvin Shi

IPC: G06F9/50

Abstract: Techniques described herein can optimize usage of computing resources in a data system. Dynamic throttling can be performed locally on a computing resource in the foreground and autoscaling can be performed in a centralized fashion in the background. Dynamic throttling can lower the load without overshooting while minimizing oscillation and reducing the throttle quickly. Autoscaling may involve scaling in or out the number of computing resources in a cluster as well as scaling up or down the type of computing resources to handle different types of situations.