A neural network is implemented as a memristive neuromorphic circuit that includes a neuron circuit and a memristive device connected to the neuron circuit. A conductance balanced voltage pair is provided for the memristive device, where the conductance balanced voltage pair includes a set voltage for increasing the conductance of the memristive device and a reset voltage for decreasing the conductance of the memristive device. Either the set voltage and reset voltage, when applied to the memristive device, effects a substantially same magnitude conductance change in the memristive device over a predetermined range of conductance of the memristive device. The provided voltage pair is stored as a conductance balanced map. A training voltage based on the conductance balanced map is applied to the memristive device to train the neural network.