An information processing apparatus includes a weight setting unit configured to set a plurality of weights of a selection layer selected from a plurality of layers of a first neural network as a plurality of weights of a second neural network; a classification unit configured to classify each of the weights of the selection layer into a first group or a second group; a first determination unit configured to determine a first gradient for each weight of the first neural network, based on first training data; a second determination unit configured to determine a second gradient for weights belonging to the first group based on second training data; and an updating unit configured to update the weights belonging to the first group based on the first gradient and the second gradient, and updating the other weights based on the first gradient.