Methods, devices and media providing an integrated teacher-student system

    公开(公告)号:US11900260B2

    公开(公告)日:2024-02-13

    申请号:US16810524

    申请日:2020-03-05

    IPC分类号: G06N3/08 G06N3/088 G06N3/045

    CPC分类号: G06N3/088 G06N3/045 G06N3/08

    摘要: Methods, devices and processor-readable media for an integrated teacher-student machine learning system. One or more teacher-student modules are trained as part of the teacher neural network training. Each student sub-network uses a portion of the teacher neural network to generate an intermediate feature map, then provides the intermediate feature map to a student sub-network to generate inferences. The student sub-network may use a feature enhancement block to map the intermediate feature map to a subsequent feature map. A compression block may be used to compress intermediate feature map data for transmission in some embodiments.