Invention Publication
- Patent Title: FRAMEWORK FOR COMPRESSION-AWARE TRAINING OF NEURAL NETWORKS
-
Application No.: US17949082Application Date: 2022-09-20
-
Publication No.: US20240095517A1Publication Date: 2024-03-21
- Inventor: Mehdi Saeedi , Ian Charles Colbert , Ihab M. A. Amer
- Applicant: Advanced Micro Devices, Inc. , ATI Technologies ULC
- Applicant Address: US CA Santa Clara
- Assignee: Advanced Micro Devices, Inc.,ATI Technologies ULC
- Current Assignee: Advanced Micro Devices, Inc.,ATI Technologies ULC
- Current Assignee Address: US CA Santa Clara; CA Markham
- Main IPC: G06N3/08
- IPC: G06N3/08

Abstract:
Methods and devices are provided for processing data using a neural network. Activations from a previous layer of the neural network are received by a layer of the neural network. Weighted values, to be applied to values of elements of the activations, are determined based on a spatial correlation of the elements and a task error output by the layer. The weighted values are applied to the values of the elements and a combined error is determined based on the task error and the spatial correlation.
Information query