Embodiments of the present disclosure relate to a new approach for workload balancing in a system. A computer-implemented method comprises obtaining a configuration of a system, wherein the configuration includes a connection relationship between components in the system. The method further comprises determining a workload threshold of a given component in the components based on the configuration, wherein a workload threshold of an upstream component of the given component is associated with a workload limit of the upstream component and a workload limit of the given component. The method further comprises determining a utilization rate of the given component based at least partially on a workload amount of the given component, the workload threshold of the given component, and the workload threshold of the upstream component. Accordingly, a more accurate utilization rate of each component in a system can be determined by considering the bottleneck of other components in the system, and thus workloads of various components in the system can be balanced from the perspective of the overall system.