Disclosed is a hologram image generating system, which includes a preprocessor that receives point cloud data to convert the received point cloud data into depth map image data, a depth map hologram processor that generates depth map hologram data based on the depth map image data, and a hologram generating device that generates a hologram image based on the depth map hologram data.