Provided is a holographic display apparatus including a light source configured to emit light, a spatial light modulator configured to form a hologram pattern to modulate the light incident thereon and reproduce a hologram image, the spatial light modulator including a plurality of display pixels that are arranged two-dimensionally, and an optical element provided opposite a light incidence surface of the spatial light modulator or a light exit surface of the spatial light modulator, the optical element including an array of a plurality of light transmission patterns that are arranged irregularly.