A multiview image generating method is provided. The multiview image generating method includes generating a hole image using depth information of an original image, dividing a boundary region in which a hole area of the generated hole image is in contact with a background into at least one patch, selecting an area having the most similar pixel value to a background included in the divided at least one patch, in a preset area of the original image, and filling a hole area on the divided at least one patch with a pixel value of the selected area to generate a first view image.