公开(公告)号：US20230196067A1

公开(公告)日：2023-06-22

申请号：US17554656

申请日：2021-12-17

Applicant: Lemon Inc.

Inventor： Peng Wang ,  Dawei Sun ,  Xiaochen Lian

IPC: G06N3/04 ,  G06V10/776

CPC classification number: G06N3/0427 ,  G06N3/0454 ,  G06V10/776

Abstract: The present disclosure describes techniques of identifying optimal scheme of knowledge distillation (KD) for vision tasks. The techniques comprise configuring a search space by establishing a plurality of pathways between a teacher network and a student network and assigning an importance factor to each of the plurality of pathways; searching the optimal KD scheme by updating the importance factor and parameters of the student network during a process of training the student network; and performing KD from the teacher network to the student network by retraining the student network based at least in part on the optimized importance factors.