A de-noising method for remote images of ground buildings using spectrum constraints. The method includes: 1) obtaining a reference image of ground buildings from a remote image database of the ground buildings, performing a Fourier transformation on the reference image to obtain an amplitude spectrum, and performing a threshold segmentation, an erosion operation and a dilation operation successively on the amplitude spectrum to obtain a binary template of spectrum of the ground buildings; and 2) obtaining a real-time image of the ground buildings by a high-speed aircraft, performing a Fourier transformation on the real-time image to obtain a spectrum, filtering the spectrum of the real-time image in frequency domain by the binary template of spectrum of the ground buildings, and performing an inverse Fourier transformation thereon to generate a filtered real-time image of the ground buildings.