An image processing device includes an imaging unit which captures an image of a subject, generates an image from a plurality of viewpoint images with different viewpoints, and displays the generated image on a display unit. A system control unit acquires a position designated using an operation unit by a user on a displayed image and detects a direction of a slide operation and an amount of movement from the designated position. An image processing unit acquires a plurality of pieces of viewpoint image data from the imaging unit and acquires distance information associated with a viewpoint image from a distance information acquisition unit. The image processing unit generates a viewpoint image if the viewpoint is moved in a direction opposite to the direction of the slide operation by the user on the basis of the plurality of viewpoint images.