A multispectral camera dynamic stereo calibration algorithm is based on saliency features. The joint self-calibration method comprises the following steps: step 1: conducting de-distortion and binocular correction on an original image according to internal parameters and original external parameters of an infrared camera and a visible light camera. Step 2: Detecting the saliency of the infrared image and the visible light image respectively based on a histogram contrast method. Step 3: Extracting feature points on the infrared image and the visible light image. Step 4: Matching the feature points extracted in the previous step. Step 5: judging a feature point coverage area. Step 6: correcting the calibration result. The present invention solves the change of a positional relationship between an infrared camera and a visible light camera due to factors such as temperature, humidity and vibration.