A compressed dynamic image encoding device is provided, in which a motion vector is generated by searching a reference image for an image area most similar to an image area of a video input signal; a motion-compensated reference image is generated from the motion vector and the reference image; a prediction residual is generated, by subtracting the motion-compensated reference image from the video input signal; the reference image is generated, by adding the motion-compensated reference image and the result of processing performed to the prediction residual; and an encoded video output signal is generated by the processing performed to the prediction residual. The reference image comprises on-screen reference images, located inside a video display screen, and an off-screen reference image located outside the video display screen, and the off-screen reference image is generated based on the positional relationship of plural similar reference images of the on-screen reference images.