Provided is a method and apparatus for determining stereo views of a stereoscopic image. The method includes: selecting a pair of first and second images from a pair of frames of the stereoscopic image, the pair of frames including a base view image and an additional view image. The method further includes determining which of the first image and the second image is the base view image and which of the first image and the second image is the additional view image based on a parallax between the pair of first and second images.