The invention discloses an infrared and visible light video image fusion method based on Surfacelet conversion, which mainly solves the problem of poor time consistency and stability of a fusion video image in the prior art. The method comprises the following steps of: firstly, carrying out multi-scale and multidirectional decomposition on an input video image by adopting Surfacelet conversion to obtain subband coefficients with different frequency domains; then, combining a low frequency subband coefficient with a band-pass direction subband coefficient of the input video image by using a fusion method of combining selection and weighted average based on three-dimensional partial space-time domain energy matching and a fusion method of combining energy and direction vector standard variance based on a three-dimensional partial space-time domain to obtain the low frequency subband coefficient and the band-pass direction subband coefficient of the fusion video image; and finally, carrying out Surfacelet conversion on each subband coefficient obtained by combination to obtain the fusion video image. The invention has the advantages of good fusion effect, high time consistency and stability and low noise sensitivity and can be used for field safety monitoring.