公开(公告)号：EP4398102A1

公开(公告)日：2024-07-10

申请号：EP23217957.2

申请日：2023-12-19

申请人： Tata Consultancy Services Limited

发明人： PHALAK, Chetan Dnyandeo ,  CHAHAL, Dheeraj ,  SINGHAL, Rekha

IPC分类号： G06F9/50

CPC分类号： G06F9/505 ,  G06F9/5083 ,  G06F9/5072 ,  G06F2209/50820130101

摘要： Cloud and Fog computing are complementary technologies used for complex Internet of Things (IoT) based deployment of applications. With an increase in the number of internet-connected devices, the volume of data generated and processed at higher speeds has increased substantially. Serving a large amount of data and workloads for predictive decisions in real-time using fog computing without Service-Level Objective (SLO) violation is a challenge. Present disclosure provides systems and method for inference management wherein a suitable execution workflow is automatically generated to execute machine learning (ML)/deep learning (DL) inference requests using fog with various type of instances (e.g., Function-as-a-Service (FaaS) instance, Machine Learning-as-a-service (MLaaS) instance, and the like) provided by cloud vendors/platforms. Generated workflow minimizes the cost of deployment as well as SLO violations.