Provided is a method and apparatus for encoding and decoding multi-view video data. The encoding method includes: decomposing each view image of the multi-view video into an overlapped region and a non-overlapped region, the overlapped region being overlapped with other view image and the non-overlapped region not being overlapped with other view image; generating a stitched image by combining the non-overlapped region of each view image and a middle view image; encoding the stitched image using a first encoding algorithm; and encoding the overlapped region of each view image, using a second encoding algorithm. Further, the decomposing step includes the steps of estimating disparity information for each view image, based on a predetermined view image; and decomposing each view image into said overlapped region and said non-overlapped region using the estimated disparity information.