SYSTEM AND METHOD FOR TRAINING STUDENT FRIENDLY TEACHER MODEL AND STUDENT MODEL

    公开(公告)号:US20220207431A1

    公开(公告)日:2022-06-30

    申请号:US17460698

    申请日:2021-08-30

    Abstract: A computer-implemented method of training a teacher model and a student model includes dividing the teacher model into a series of teacher blocks each comprising at least one layer; generating a first student branch receiving a first feature output from a first teacher block among the series of teacher blocks; training the teacher model based on outputs of the teacher model and the first student branch; and training the student model comprising a series of student blocks based on the trained teacher model, wherein the first student branch includes at least one student block.

Patent Agency Ranking