Generating a prediction image by performing motion compensation by using a motion vector of an encoded image, with a frame formed of a decoded image serving as a reference frame, to generate a first motion compensation image corresponding to a prediction image; and generating the prediction image by performing a filtering process on at least two motion-compensated images by using a correlation in a time direction included in the first motion compensation image and a second motion compensation image.