An image processing apparatus comprising: an input visual environment acquisition unit that acquires a shooting scene viewing condition at the time of shooting an image, an output visual environment acquisition unit that acquires a shot image viewing condition, a converting unit that converts the image using a predetermined color appearance model based on the shooting scene viewing condition acquired by the input visual environment acquisition unit and the shot image viewing condition acquired by the output visual environment acquisition unit, and a correction unit that corrects a parameter of the color appearance model used by the converting unit by using at least one of a shooting condition of the image and a scene judging result based on at least one of the image and the shooting conditions of the image.