Video encoding and decoding accompanying inter prediction and motion compensation in a multi-view video prediction structure. A multi-view video prediction restoring method includes receiving a base view image stream and additional view image streams for two or more additional views; restoring base view images including base view anchor pictures that are I-picture type images by performing motion compensation referring to the base view images by using the base view image stream; and restoring images of a first additional view by performing at least one of disparity compensation referring to the restored base view images and motion compensation referring to images except for an anchor picture having a preceding reproduction order among the images of the first additional view by using an image stream of the first additional view among the additional view image streams.