METHOD FOR TRAINING AN ARTIFICIAL NEURAL NETWORK COMPRISING QUANTIZED PARAMETERS

    公开(公告)号:US20230112397A1

    公开(公告)日:2023-04-13

    申请号:US18074166

    申请日:2022-12-02

    Abstract: In an implementation, a neural network training method comprises: minimizing a loss function, the loss function comprising a scalable regularization factor defined by a differentiable periodic function configured to provide a finite number of minima selected based on a quantization scheme for the artificial neural network, whereby to constrain a connection weight value to one of a predetermined number of values of the quantization scheme, wherein the artificial neural network comprises multiple nodes each defining a quantized activation function configured to output a quantized activation value, wherein the multiple nodes are arranged in multiple layers, and wherein nodes in adjacent layers of the multiple layers are connected by connections each defining a quantized connection weight function configured to output a quantized connection weight value.

Patent Agency Ranking