A growth transform neural network system is disclosed that includes a computing device with at least one processor and a memory storing a plurality of modules, including a growth transform neural network module, a growth transform module, and a network convergence module. The growth transform neural network module defines a plurality of mirrored neuron pairs that include a plurality of first components and a plurality of second components. Each first and second component is connected by a normalization link. The first components are interconnected according to an interconnection matrix, and the second components are interconnected according to the interconnection matrix. The growth transform module updates each first component of each mirrored neuron pair according to a growth transform neuron model. The network convergence module converges the plurality of mirrored neuron pairs to a steady state condition by solving a system objective function subject to at least one normalization constraint.