Invention Publication
- Patent Title: NEURAL NETWORK DISTILLATION METHOD AND APPARATUS
-
Application No.: US18157277Application Date: 2023-01-20
-
Publication No.: US20230162005A1Publication Date: 2023-05-25
- Inventor: Pengxiang CHENG , Zhenhua DONG , Xiuqiang HE , Xiaolian ZHANG , Shi YIN , Yuelin HU
- Applicant: HUAWEI TECHNOLOGIES CO., LTD.
- Applicant Address: CN SHENZHEN
- Assignee: HUAWEI TECHNOLOGIES CO., LTD.
- Current Assignee: HUAWEI TECHNOLOGIES CO., LTD.
- Current Assignee Address: CN SHENZHEN
- Main IPC: G06N3/045
- IPC: G06N3/045

Abstract:
This application provides a neural network distillation method and apparatus in the field of artificial intelligence. The method includes: obtaining a sample set, where the sample set includes a biased data set and an unbiased data set, the biased data set includes biased samples, and the unbiased data set includes unbiased samples; determining a first distillation manner based on data features of the sample set, where, in the first distillation manner, a teacher model is trained by using the unbiased data set and a student model is trained by using the biased data set; and training a first neural network based on the biased data set and the unbiased data set in the first distillation manner, to obtain an updated first neural network.
Information query