Disclosed herein is a three-dimensional image display apparatus, including: a light source configured to emit light from a plurality of light emitting positions disposed discretely; optical modulation means for including a plurality of pixels and configured such that a plurality of light beams successively emitted from the different light emitting positions of the light source and having different incoming directions from each other are modulated individually by the pixels to generate two-dimensional images and spatial frequencies of the generated two-dimensional images are individually emitted along diffraction angles corresponding to a plurality of diffraction orders generated from the pixels; and Fourier transform image forming means for Fourier transforming the spatial frequencies of the two-dimensional images emitted from the optical modulation means to produce a number of Fourier transform images corresponding to the plural number of diffraction orders to form the Fourier transform images.