Disclosed herein is a three-dimensional image display apparatus includes a light source, a light modulation section modulates light from the light source by means of pixels to produce two-dimensional images and emits a spatial frequency of the produced two-dimensional images along diffraction angles corresponding to a plurality of diffraction orders produced from each pixel, a Fourier transform image formation section Fourier transforms the spatial frequency of the two-dimensional images emitted from the light modulation section to produce Fourier transform images whose number corresponds to the number of diffraction orders, a Fourier transform image selection section selects one of the Fourier transform images produced by the Fourier transform section which corresponds to a desired diffraction order, a conjugate image formation section forms a conjugate image of the Fourier transform image selected by the Fourier transform image selection section.