APPARATUS, METHOD, AND SYSTEM FOR DYNAMIC POD AUTOSCALING IN A SERVERLESS COMPUTING ENVIRONMENT

    公开(公告)号:US20240205290A1

    公开(公告)日:2024-06-20

    申请号:US18515505

    申请日:2023-11-21

    CPC classification number: H04L67/101 H04L67/1008

    Abstract: An apparatus, method, and system for dynamic pod autoscaling in a serverless computing environment are disclosed. A dynamic pod autoscaling apparatus in a serverless computing environment comprises a processor; and a memory connected to the processor, wherein the memory stores program instructions for performing operations comprising registering, if there is a service request, a predefined first target value, collecting concurrency/rps (request per second) information of a first number of pods corresponding to the number of replica sets that is pod autoscaled according to the first target value, calculating the first target value as a second target value using the concurrency/rps information and average resource usage of the pod, dynamically changing the number of replica sets from the first number to a second number through the second target value.

Patent Agency Ranking