A computer-based method for automatic detection of water regions in a video include the steps of estimating a water map of the video and outputting the water map to an output medium, such as a video analysis system. The method may further include the steps of training a water model from the water map; re-classifying the water map using the water model by detecting water pixels in the video; and refining the water map.