Dynamic task allocation and datastore scaling

    公开(公告)号:US12164966B1

    公开(公告)日:2024-12-10

    申请号:US18351388

    申请日:2023-07-12

    Applicant: Snowflake Inc.

    Abstract: A system and method of dynamic task allocation and warehouse scaling. The method includes receiving a request to process a task. The method includes monitoring a plurality of execution nodes of a datastore to determine a plurality of central processing unit (CPU) utilizations. Each CPU utilization of the plurality of CPU utilizations is associated with a respective execution node of the plurality of execution nodes. The method includes identifying, by a processing device based on the plurality of CPU utilizations, a particular execution node associated with a maximum CPU utilization to process the task. The method includes allocating the task to the particular execution node.

    ALLOCATING TASKS BASED ON LAG OF AN EXECUTION NODE

    公开(公告)号:US20250045112A1

    公开(公告)日:2025-02-06

    申请号:US18923211

    申请日:2024-10-22

    Applicant: Snowflake Inc.

    Abstract: A system and method of allocating tasks based on the lag of one or more execution nodes. The method includes monitoring a plurality of execution nodes of a datastore to determine a plurality of central processing unit (CPU) utilizations, each CPU utilization of the plurality of CPU utilizations is associated with a respective execution node of the plurality of execution nodes. The method includes identifying, by a processing device based on the plurality of CPU utilizations, a particular execution node associated with a maximum CPU utilization to process a task. The method includes determining a lag amount associated with the maximum CPU utilization. The method includes preventing an allocation of the task to the particular execution node for a time period that is equal to or greater than the lag amount.

Patent Agency Ranking