According to an aspect of the present invention, for which of the original image data before the gradation correction and the original image data after the gradation correction the restoration process is performed is determined depending on whether or not the image information meets the condition under which the ringing appears in the recovery image data due to the restoration process. When the gradation correction is performed after the restoration process, there is a probability that the side effect (the ringing or the like) of the restoration process is emphasized by the gradation correction. Therefore, in the case where the image information meets the condition under which the ringing appears, it is possible to prevent such a side effect (the ringing or the like) of the restoration process from being emphasized by the gradation correction, by performing the restoration process for the original image data after the gradation correction.