A video enhancement system provides automatic enhancement to video data that includes the presence of obscurations. The system provides near-field enhancement of the video data by detecting the presence of near-field obscurations such as snowflakes/raindrops and determining whether the detected obscurations are located over background pixels or foreground objects. The detected obscuration pixels are filled-in depending on whether they are located over the background or foreground to create an enhanced image. The system may also provide local/global adaptive contrast enhancement to enhance video in the presence of far-field obscurations.