The invention discloses a multi-exposure image fusion method of automatically removing ghosts. The multi-exposure image fusion method of automatically removing ghosts provides an effective method of moving object selection, for the phenomenon that ghosts exist in multi-exposure image fusion of a dynamic scene. The multi-exposure image fusion method of automatically removing ghosts includes the steps: selecting one input LDR image as a reference image, detecting the motion area by means of a method of bidirectional luminance mapping, calculating the motion weight, and automatically removing theghosts by means of a method of gradient domain weighted optimization so as to obtain a latent image; and after removing the ghosts, calculating the fusion weight by means of the fusion method based on blocks, performing exposure fusion, maintaining the detailed information and suppressing the abnormal value. The multi-exposure image fusion method of automatically removing ghosts can effectively maintain the details of a plurality of input images and remove the ghosts, can avoid complicated parameter setting and arbitrariness for a user to set the threshold, and has higher robustness for the ghost phenomenon in various scenes.