Provided is an apparatus and method for generating a virtual view in an image reconstruction system which uses multiple views. In the image reconstruction system which uses multiple views, the virtual view generating apparatus may receive original view projection images that are generated by emitting X rays toward an object via original views, three-dimensionally reconstruct the object by using the original view projection images, generate original view reprojection images by virtually emitting X-rays toward the reconstructed 3D object via the original views, estimate a motion of the reconstructed 3D object with respect to at least two of the original view reprojection images using a block-based motion estimation scheme, and generate an intermediate view projection image with respect to the at least two of the original view reprojection images by using information relating to the estimated motion.