An image processing apparatus having: an image acquisition unit that acquires a plurality of viewpoint images; a disparity map generation unit that generates a disparity map representing a disparity distribution; a multi-viewpoint image generation unit that generates a multi-viewpoint image including a plurality of viewpoint images the number of which is larger than the number of the plurality of viewpoint images based on the plurality of viewpoint images and the disparity map; an image processing unit that performs image processing for a subject image of the multi-viewpoint image based on the multi-viewpoint image and the disparity map and switches an amount of image processing for the subject image depending on the disparity; and an output unit that switches the plurality of viewpoint images included in the multi-viewpoint image, which has been subjected to image processing by the image processing unit, and sequentially outputs the viewpoint images.