PROVIDING APPLICATION PROGRAMMING INTERFACE ENDPOINTS FOR MACHINE LEARNING MODELS

    公开(公告)号:US20210055977A1

    公开(公告)日:2021-02-25

    申请号:US16990233

    申请日:2020-08-11

    摘要: One or more virtual machines are launched at an application platform. At each of the one or more virtual machines, a machine learning model execution environment is instantiated for an instance of a machine learning model. A respective instance of the machine learning model is loaded to each machine learning model execution environment. Each loaded instance of the machine learning model is associated with an application programming interface (API) endpoint which can receive input data for the loaded instance of the machine learning model from a client device and return output data produced by the loaded instance of the machine learning model based on the input data.

    PROVIDING APPLICATION PROGRAMMING INTERFACE ENDPOINTS FOR MACHINE LEARNING MODELS

    公开(公告)号:US20220179723A1

    公开(公告)日:2022-06-09

    申请号:US17680859

    申请日:2022-02-25

    摘要: One or more virtual machines are launched at an application platform. At each of the one or more virtual machines, a machine learning model execution environment is instantiated for an instance of a machine learning model. A respective instance of the machine learning model is loaded to each machine learning model execution environment. Each loaded instance of the machine learning model is associated with an application programming interface (API) endpoint which can receive input data for the loaded instance of the machine learning model from a client device and return output data produced by the loaded instance of the machine learning model based on the input data.