A holographic display device includes a light source configured to emit light, the light including first light of a first wavelength, second light of a second wavelength, and third light of a third wavelength; a spatial light modulator configured to form a holographic pattern to modulate the light emitted from the light source and to produce a holographic image; and a focusing optical system configured to focus the holographic image. The focusing optical system includes a fixed-focus optical system having a fixed focal length, and a variable focus optical system having a focal length that is changed by electrical control. The fixed-focus optical system is configured to focus the first light of the first wavelength, the second light of the second wavelength, and the third light of the third wavelength on different positions, respectively, on an optical axis to cancel a chromatic aberration by the variable focus optical system.