The present application is suitable for use in the technical field of computers, and provides a smart diagnosis assistance method and terminal based on medical images, comprising: acquiring a medical image to be classified; pre-processing the medical image to be classified to obtain a pre-processed image; and inputting the pre-processed image into a trained classification model for classification processing to obtain a classification type corresponding to the pre-processed image, the classification model comprising tensorized network layers and a second-order pooling module. As the trained classification model comprises tensor decomposed network layers and a second-order pooling module, when processing images on the basis of the classification model, more discriminative features related to pathologies can be extracted, increasing the accuracy of medical image classification.