Provided is a steroscopic video encoding and/or decoding apparatus that supports multi-display modes, the encoding/decoding method thereof, and computer-readable recording medium for recording a program that implements the encoding/decoding method. The encoding apparatus of this research incorporates: a field separating means for separating right and left-eye input images into an odd field of the left-eye image (LO), even field of the left-eye image (LE), odd-numbered field (RO) of the right-eye image, and even-numbered field (RE) of the right-eye image; an encoding means for encoding the fields separated in the field separating means by performing motion and disparity compensation; and a multiplexing means for multiplexing the essential fields among the fields received from the encoding means, based on the user display information.