A hologram display device includes a light source unit that generates light, a spatial light modulation panel that spatially modulates light received from the light source unit and generates diffracted light, and an optical unit that generates a holographic image using the diffracted light. The spatial light modulation panel includes first color filters, second color filters, and third color filters. The number of the second color filters is greater than the number of each of the first and third color filters. During a turned-on state of the spatial light modulation panel, a shortened distance in a predetermined direction between second color images displayed through the second color filters is substantially equal to a distance in the predetermined direction between first color images displayed through the first color filters and a distance in the predetermined direction between third color images displayed through the third color filters.