Techniques are disclosed for schedule management for machine learning model-based processing in a computing environment. For example, a method receives a machine learning model-based request and determines a scheduling decision for execution of the machine learning model-based request. Determination of the scheduling decision comprises identifying, based on one or more metrics, at least one cluster from a plurality of clusters as an execution environment in which the machine learning model-based request is to be executed. The machine learning model-based request may then be forwarded to the at least one identified cluster for execution.