公开(公告)号：US20230162005A1

公开(公告)日：2023-05-25

申请号：US18157277

申请日：2023-01-20

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Pengxiang CHENG ,  Zhenhua DONG ,  Xiuqiang HE ,  Xiaolian ZHANG ,  Shi YIN ,  Yuelin HU

IPC: G06N3/045

CPC classification number: G06N3/045

Abstract: This application provides a neural network distillation method and apparatus in the field of artificial intelligence. The method includes: obtaining a sample set, where the sample set includes a biased data set and an unbiased data set, the biased data set includes biased samples, and the unbiased data set includes unbiased samples; determining a first distillation manner based on data features of the sample set, where, in the first distillation manner, a teacher model is trained by using the unbiased data set and a student model is trained by using the biased data set; and training a first neural network based on the biased data set and the unbiased data set in the first distillation manner, to obtain an updated first neural network.