发明公开
- 专利标题: METHOD AND SYSTEM FOR A TEMPERATURE-RESILIENT NEURAL NETWORK TRAINING MODEL
-
申请号: US18463778申请日: 2023-09-08
-
公开(公告)号: US20240095528A1公开(公告)日: 2024-03-21
- 发明人: Jae-sun Seo , Jian Meng , Li Yang , Deliang Fan
- 申请人: Jae-sun Seo , Jian Meng , Li Yang , Deliang Fan
- 申请人地址: US AZ Tempe
- 专利权人: Arizona Board of Regents on behalf of Arizona State University
- 当前专利权人: Arizona Board of Regents on behalf of Arizona State University
- 当前专利权人地址: US AZ Scottsdale
- 主分类号: G06N3/08
- IPC分类号: G06N3/08 ; G06N3/0495
摘要:
A method for increasing the temperature-resiliency of a neural network, the method comprising loading a neural network model into a resistive nonvolatile in-memory-computing chip, training the deep neural network model using a progressive knowledge distillation algorithm as a function of a teacher model, the algorithm comprising injecting, using a clean model as the teacher model, low-temperature noise values into a student model and changing, now using the student model as the teacher model, the low-temperature noises to high-temperature noises, and training the deep neural network model using a batch normalization adaptation algorithm, wherein the batch normalization adaptation algorithm includes training a plurality of batch normalization parameters with respect to a plurality of thermal variations.
信息查询