The invention provides a panoramic infrared spectral imaging system. The panoramic infrared spectral imaging system comprises an optical system, an infrared focal plane detector, a numerical control rotary table, a signal and image processing module, a display module and a controller module. The optical system comprises a front telescope objective, a slit, a collimating lens, a reflecting gratingand an imaging lens. By adopting the reflecting grating and utilizing spectral imaging of the reflecting grating, the real-time performance is very high, various gas types can be quickly and accurately recognized, the numerical control rotary table is used, the view field angle in the horizontal direction is expanded in a rotating mode, and panoramic detection in the horizontal direction can be achieved.