Invention Application
- Patent Title: OPTIMISING A NEURAL NETWORK
-
Application No.: US18055192Application Date: 2022-11-14
-
Publication No.: US20230073669A1Publication Date: 2023-03-09
- Inventor: Mark John O'CONNOR
- Applicant: Arm Limited
- Applicant Address: GB Cambridge
- Assignee: Arm Limited
- Current Assignee: Arm Limited
- Current Assignee Address: GB Cambridge
- Priority: GB2007329.2 20200518
- Main IPC: G06N3/08
- IPC: G06N3/08 ; G06N3/04

Abstract:
A computer-implemented method of optimising a student neural network (SNN), based on a previously-trained neural network (PTNN) trained on first data (FD) using a first processing system (FPS). The method includes using a second processing system (SPS) to generate reference output data (ROD) from the previously-trained neural network (PTNN) in response to inputting second data (SD) to the previously-trained neural network (PTNN). The method also includes optimising a student neural network (SNN) for processing the second data (SD) with the second processing system (SPS), by using the second processing system (SPS) to adjust a plurality of parameters of the student neural network (SNN) such that a difference (DIFF) between the reference output data (ROD), and second output data (SOD) generated by the student neural network (SNN) in response to inputting the second data (SD) to the student neural network (SNN), satisfies a stopping criterion.
Information query