A multi-view video encoding method multiplexes an encoded multi-view image by a predetermined data unit and adds a scalable extension type (SET) indicating which view of image among a basic view image and an additional view image is related to data included in the predetermined data unit, a depth flag indicating which image is related to the data among a texture image and a depth map image, and a view ID of the data to a header of the predetermined data unit.