A method for processing a three-dimensional holographic image includes obtaining depth images from depth data of a three-dimensional object, dividing each of the depth images into a predetermined number of sub-images, obtaining interference patterns of computer-generated hologram (CGH) patches corresponding to each of the sub-images by performing a Fourier transform to calculate an interference pattern in a CGH plane for object data included in each of the sub-images, and generating a CGH for the three-dimensional object using the obtained interference patterns of the CGH patches.