An image processing apparatus is provided. The image processing apparatus may include a determining unit configured to determine at least one pixel having a pixel value difference between a first image and a second image lower than a critical value, among a plurality of input frame images to compute a hologram pattern, and a computing unit configured to compute a hologram pattern of the first image and to compute a hologram pattern of the second image using a computation result for the at least one pixel of the first image.