A method of increasing temporal resolution the method a) provides a current video having an initial spatial resolution and an initial temporal resolution, the current video has a temporally reduced video of an original video; b) repeatedly reduces the spatial resolution of the current video and the original video to produce a lowest spatial resolution current video and original video, the lowest spatial resolution current video having the initial temporal resolution; c) increases the temporal resolution of the lowest spatial resolution current video; d) increases the temporal resolution of the next higher spatial resolution current video; and e) repeats step (d) up to the initial spatial resolution. Steps c) and d) further include calculating enhancement data and using the enhancement data to enhance the increased temporal resolution of the current video, the calculating including using the respective reduced spatial resolution original video.