A color calibration apparatus includes an image obtaining unit configured to obtain first and second photographed images which are generated by photographing first and second mono-color test images displayed on the display device; a controller configured to detect an ambient light area on which an ambient light is shining within the first photographed image based on pixel values of the first photographed image, and further configured to determine a remaining area of the first photographed image other than the ambient light area as a representative value calculating area; and an image processor configured to calculate a representative value based on pixel values of an area corresponding to the representative value calculating area within the second photographed image, and further configured to perform color calibration of the display device based on the representative value.