A method for converting an image in an image conversion apparatus is provided. The method includes receiving a stereo image, down-scaling the stereo image, performing stereo-matching by applying adaptive weight to the down-scaled stereo images, generating a depth map according to the stereo-matching, up-scaling the depth map by referring to an input image of original resolution, and generating a plurality of multi-view images by performing depth-image-based rendering with respect to the up-scaled depth map and the input image of original resolution. Accordingly, a plurality of multi-view images may be obtained with ease.