The present invention discloses a holographic display apparatus including a light irradiating unit configured to irradiate light using an optical fiber array backlight, a spatial light modulator (SLM) configured to perform modulating the irradiated light, a lens configured to irradiate hologram images based on the modulated light, a pupil tracking unit configured to acquire location of an observer's pupil by pupil tracking, and a hologram generating unit configured to generate parallax hologram images that correspond to the location of pupil.