According to the present invention, when restoration processing of a taken image by the use of a restoration filter corresponding to a subject distance is performed, by storing only a corresponding restoration filter in a subject distance range between the estimation variation close range and the infinity such that a restoration filter in a range on the nearer side than the estimation variation close range is not provided from the beginning, it is thereby possible to reduce the number of restoration filters held beforehand.