An image display device includes a main light source configured to emit a first light; a display panel configured to modulate the first light to add image information to the first light; a holographic optical element (HOE) configured to diffract the first light emitted from the display panel to make the first light travel to a first region to generate a main image; a first optical system provided on a traveling path of the first light between the main light source and the HOE, the first optical system being configured to change the traveling path of the first light to be incident on the HOE along a first path; an auxiliary light source configured to emit a second light; and a second optical system provided on a traveling path of the second light, the second optical system being configured to change a traveling path of the second light to be incident on the HOE along a second path different from the first path.