A method of removing raindrops from video images is provided. The method includes the steps of: training a raindrop image recognition model using a plurality raindrop training images labeled in a plurality of rainy-scene images; recognizing a plurality of raindrop images from a plurality of scene images in a video sequence using the raindrop image recognition model; and in response to a specific raindrop image in a current scene image satisfying a predetermined condition, replacing the specific raindrop image in the current scene image with an image region corresponding to the specific raindrop image in a specific scene image prior to the current scene image to generate an output scene image.