A computer-implemented method for training a neural network system. The method includes receiving at least a first data vector at a first layer of the neural network system; applying a function to the first data vector to generate at least a second data vector, wherein the function is based on a layer parameter of the first layer that includes at least a weight matrix of the first layer; comparing at least the first data vector and the second data vector to obtain a loss value that represents a difference between the first data vector and the second data vector; updating the layer parameter based on the loss value; and adjusting the layer parameter based on a comparison of the updated layer parameter with a threshold value of the first layer.