The invention relates to a system and a method of detecting interference of a wireless signal based on spectral analysis. The system comprises a data acquisition unit, a data preprocessing unit, a feature extraction unit, a classification detection unit and a display unit, wherein the data acquisition unit is used for collecting the wireless signal in the environment, carrying out fast Fourier transform FFT on the collected wireless signal to obtain FFT data provided with frequency spectrum information, and transmitting the collected wireless signal to the data preprocessing unit; the data preprocessing unit is used for obtaining time domain information and the frequency spectrum from the collected wireless signal, and transmitting the time domain information and the frequency spectrum to the feature extraction unit; the feature extraction unit is used for carrying out feature extraction on the time domain information and the frequency spectrum which are obtained by the data preprocessing unit, and transmitting the extracted frequency spectrum features to a classification recognition unit; the classification detection unit is used for carrying out training and classification recognition on the frequency spectrum features extracted by the feature extraction unit, and transmitting a result obtained after training and classification recognition to the display unit; the display unit is used for providing an interactive interface for displaying a recognition result.