Invention Grant
- Patent Title: Systems and methods for modification of neural networks based on estimated edge utility
-
Application No.: US16274599Application Date: 2019-02-13
-
Publication No.: US11734568B2Publication Date: 2023-08-22
- Inventor: Jyrki Alakuijala , Ruud van Asseldonk , Robert Obryk , Krzysztof Potempa
- Applicant: Google LLC
- Applicant Address: US CA Mountain View
- Assignee: GOOGLE LLC
- Current Assignee: GOOGLE LLC
- Current Assignee Address: US CA Mountain View
- Agency: Dority & Manning, P.A.
- Main IPC: G06N3/082
- IPC: G06N3/082 ; G06N3/084 ; G06N20/20 ; G06N3/045

Abstract:
The present disclosure provides systems and methods for modification (e.g., pruning, compression, quantization, etc.) of artificial neural networks based on estimations of the utility of network connections (also known as “edges”). In particular, the present disclosure provides novel techniques for estimating the utility of one or more edges of a neural network in a fashion that requires far less expenditure of resources than calculation of the actual utility. Based on these estimated edge utilities, a computing system can make intelligent decisions regarding network pruning, network quantization, or other modifications to a neural network. In particular, these modifications can reduce resource requirements associated with the neural network. By making these decisions with knowledge of and based on the utility of various edges, this reduction in resource requirements can be achieved with only a minimal, if any, degradation of network performance (e.g., prediction accuracy).
Public/Granted literature
- US20190251444A1 Systems and Methods for Modification of Neural Networks Based on Estimated Edge Utility Public/Granted day:2019-08-15
Information query