公开(公告)号：US11537566B1

公开(公告)日：2022-12-27

申请号：US17806852

申请日：2022-06-14

Applicant: Snowflake Inc.

Inventor： Johan Harjono ,  Daniel Geoffrey Karp ,  Rares Radut ,  Samir Rehmtulla ,  Arthur Kelvin Shi ,  Thanakul Wattanawong

IPC: G06F16/00 ,  G06F16/182 ,  G06F16/28

Abstract: The subject technology determines an availability zone skew among multiple zones. The subject technology, based on the availability zone skew, determines a target skew to meet a global balancing of cluster instances. The subject technology, based on the target skew, selects a particular zone among multiple zones. The subject technology deploys a particular type of cluster instance to the particular zone. The subject technology, for each zone from the multiple zones, determining a respective number of cluster instances. The subject technology identifies a first zone that includes a highest number of cluster instances based on the respective number of cluster instances from each zone. The subject technology identifies a second zone that includes a lowest number of cluster instances based on the respective number of cluster instances from each zone.

公开(公告)号：US11507465B1

公开(公告)日：2022-11-22

申请号：US17647687

申请日：2022-01-11

Applicant: Snowflake Inc.

Inventor： Ata E. Husain Bohra ,  Daniel Geoffrey Karp

IPC: G06F11/14 ,  G06F16/245 ,  G06F16/25 ,  G06F9/50

Abstract: The subject technology requests information regarding an instance identifier of a compute service manager instance to a particular job. The subject technology retrieves information related to a set of instances of compute service managers in a set of virtual warehouses. The subject technology filters the information to determine a set of candidates from the set of instances of compute service managers. The subject technology sorts the set of candidates based at least in part on a workload. The subject technology selects a candidate compute service manager to issue a query restart by randomly selecting an execution node.

公开(公告)号：US11461150B1

公开(公告)日：2022-10-04

申请号：US17462658

申请日：2021-08-31

Applicant: Snowflake Inc.

Inventor： Johan Harjono ,  Daniel Geoffrey Karp ,  Kunal Prafulla Nabar ,  Rares Radut ,  Arthur Kelvin Shi

IPC: G06F9/50 ,  G06F9/355

Abstract: Techniques described herein can optimize usage of computing resources in a data system. Dynamic throttling can be performed locally on a computing resource in the foreground and autoscaling can be performed in a centralized fashion in the background. Dynamic throttling can lower the load without overshooting while minimizing oscillation and reducing the throttle quickly. Autoscaling may involve scaling in or out the number of computing resources in a cluster as well as scaling up or down the type of computing resources to handle different types of situations.

公开(公告)号：US11372820B1

公开(公告)日：2022-06-28

申请号：US17461169

申请日：2021-08-30

Applicant: Snowflake Inc.

Inventor： Johan Harjono ,  Daniel Geoffrey Karp ,  Rares Radut ,  Samir Rehmtulla ,  Arthur Kelvin Shi ,  Thanakul Wattanawong

IPC: G06F16/00 ,  G06F16/182 ,  G06F16/28

Abstract: The subject technology determines, after a period of time elapses over a periodic segment of time, an imbalance of cluster instances deployed in multiple zones based on a threshold value, the cluster instances including different types of clusters associated with compute service manager instances. The subject technology identifies a particular type of cluster instance to include in a particular zone from the multiple zones. The subject technology adds the particular type of cluster instance to the particular zone to meet a global balancing of cluster instances in the multiple zones. The subject technology determines, after a second period of time elapses over the periodic segment of time, that a number of cluster instances deployed in the multiple zones is below the threshold value indicating a current balance of cluster instances in the multiple zones.

公开(公告)号：US12217088B2

公开(公告)日：2025-02-04

申请号：US18497260

申请日：2023-10-30

Applicant: Snowflake Inc.

Inventor： Johan Harjono ,  Daniel Geoffrey Karp ,  Kunal Prafulla Nabar ,  Rares Radut ,  Arthur Kelvin Shi

IPC: G06F9/50 ,  G06F9/355

Abstract: Techniques described herein can optimize usage of computing resources in a data system. Dynamic throttling can be performed locally on a computing resource in the foreground and autoscaling can be performed in a centralized fashion in the background. Dynamic throttling can lower the load without overshooting while minimizing oscillation and reducing the throttle quickly. Autoscaling may involve scaling in or out the number of computing resources in a cluster as well as scaling up or down the type of computing resources to handle different types of situations.

公开(公告)号：US11966368B2

公开(公告)日：2024-04-23

申请号：US18326645

申请日：2023-05-31

Applicant: Snowflake Inc.

Inventor： Johan Harjono ,  Daniel Geoffrey Karp ,  Rares Radut ,  Samir Rehmtulla ,  Arthur Kelvin Shi ,  Thanakul Wattanawong

IPC: G06F16/00 ,  G06F16/182 ,  G06F16/28

CPC classification number: G06F16/1824 ,  G06F16/285

Abstract: The subject technology selects a particular zone among multiple zones based on a target skew to meet a global balancing of cluster instances. The subject technology deploys a particular type of cluster instance to the particular zone. The subject technology, for each zone from the multiple zones, determines a respective number of cluster instances. The subject technology identifies a second particular type of cluster instance to add based on a total number of the second particular type of cluster instance in the multiple zones and a second total number of the particular type of cluster instance in the multiple zones. The subject technology adds the second particular type of cluster instance to a second particular zone to meet the global balancing of cluster instances in the multiple zones.

公开(公告)号：US11704200B2

公开(公告)日：2023-07-18

申请号：US17823877

申请日：2022-08-31

Applicant: Snowflake Inc.

Inventor： Ata E. Husain Bohra ,  Daniel Geoffrey Karp

IPC: G06F11/14 ,  G06F16/245 ,  G06F16/25 ,  G06F9/50

CPC classification number: G06F11/1435 ,  G06F9/505 ,  G06F9/5022 ,  G06F9/5038 ,  G06F16/245 ,  G06F16/256

Abstract: The subject technology retrieves information related to a set of instances of compute service managers, each instance of a particular compute service manager being associated with a set of virtual warehouses. The subject technology filters the information to determine a set of candidates from the set of instances of compute service managers. The subject technology sorts the set of candidates based at least in part on each workload of each of the set of candidates. The subject technology selects a candidate compute service manager from the set of instances of compute service managers to issue a query restart by randomly selecting an execution node, the execution node being included in a particular virtual warehouse associated with the candidate compute service manager, the selecting facilitating improving utilization of cluster resources and improving query execution on the selected candidate compute service manager.

公开(公告)号：US11698886B2

公开(公告)日：2023-07-11

申请号：US17936169

申请日：2022-09-28

Applicant: Snowflake Inc.

Inventor： Johan Harjono ,  Daniel Geoffrey Karp ,  Rares Radut ,  Samir Rehmtulla ,  Arthur Kelvin Shi ,  Thanakul Wattanawong

IPC: G06F16/00 ,  G06F16/182 ,  G06F16/28

CPC classification number: G06F16/1824 ,  G06F16/285

Abstract: The subject technology selects a particular zone among multiple zones based on a target skew to meet a global balancing of cluster instances. The subject technology deploys a particular type of cluster instance to the particular zone. The subject technology, for each zone from the multiple zones, determines a respective number of cluster instances. The subject technology identifies a second particular type of cluster instance to remove based on a total number of the second particular type of cluster instance in the multiple zones and a second total number of the particular type of cluster instance in the multiple zones. The subject technology removes the second particular type of cluster instance from a second particular zone to meet the global balancing of cluster instances in the multiple zones.

公开(公告)号：US20230069578A1

公开(公告)日：2023-03-02

申请号：US17936169

申请日：2022-09-28

Applicant: Snowflake Inc.

Inventor： Johan Harjono ,  Daniel Geoffrey Karp ,  Rares Radut ,  Samir Rehmtulla ,  Arthur Kelvin Shi ,  Thanakul WATTANAWONG

IPC: G06F16/182 ,  G06F16/28

Abstract: The subject technology selects a particular zone among multiple zones based on a target skew to meet a global balancing of cluster instances. The subject technology deploys a particular type of cluster instance to the particular zone. The subject technology, for each zone from the multiple zones, determines a respective number of cluster instances. The subject technology identifies a second particular type of cluster instance to remove based on a total number of the second particular type of cluster instance in the multiple zones and a second total number of the particular type of cluster instance in the multiple zones. The subject technology removes the second particular type of cluster instance from a second particular zone to meet the global balancing of cluster instances in the multiple zones.