There are provided a method of knowledge transferring, an information processing apparatus and a storage medium. The method of knowledge transferring includes: obtaining a first model which has been trained in advance with respect to a predetermined task; and training a second model with respect to the predetermined task by utilizing a comprehensive loss function, such that the second model has knowledge of the first model. The comprehensive loss function is based on a first loss function weighted by accuracy of an output result of the first model for a training sample in regard to the predetermined task, and a second loss function. The first loss function represents a difference between processing results of the second model and the first model for the training sample. The second loss function represents accuracy of an output result of the second model for the training sample in regard to the predetermined task.