公开(公告)号：US20250013551A1

公开(公告)日：2025-01-09

申请号：US18890749

申请日：2024-09-19

Applicant: Beijing Baidu Netcom Science Technology Co., Ltd.

Inventor： Chengcheng WU ,  Ye ZHANG ,  Baoju LIU ,  Zeyu WANG

IPC: G06F11/34

Abstract: The present disclosure provides a method and apparatus for evaluating a model service, an electronic device, and a storage medium, relates to the technical field of edge computers, in particular to the technical fields of intelligent Internet of Things, edge intelligent devices, or the like. A specific implementation solution is as follows: receiving an evaluation sample set from cloud, the evaluation sample set including a to-be-evaluated model and a dataset corresponding to the to-be-evaluated model and containing labelling information; performing model inference on the to-be-evaluated model based on data in the dataset, to obtain an inference result corresponding to the to-be-evaluated model; and calculating a performance evaluation metrics based on the labelling information in the dataset and the inference result, to obtain an evaluation result corresponding to the to-be-evaluated model.