A method for delivering video over a network includes encoding, by a server, a sequence of video frames as a compressed video stream comprising an initial I-frame followed by a plurality P-frames, the sequence having a skipped frame which is not encoded. The compressed video stream is transmitted over a network to a client device, the skipped frame not being transmitted. In response to detecting the skipped frame, the client device generating a predicted frame that replaces the skipped frame in the compressed video stream, the predicted frame being generated based on extending delta information from one or more previous frames decoded by the client device.