A three-dimensional (3D) image display apparatus includes a processor configured to determine, from image data of a 3D image to be displayed, a representative depth value based on a current frame of the 3D image and a previous frame of the 3D image, and an imaging optical system configured to generate the 3D image in a predetermined space by modulating light based on the representative depth value.