An image processing apparatus for generating image data for displaying a stereoscopic image on the basis of an image for a left eye and an image for a right eye, the image processing apparatus includes first detecting means for detecting image pairs each taken in a continuous shooting mode among a plurality of images, second detecting means for detecting image pairs each taken consecutively within a predetermined time among the plurality of images, presenting means for presenting the image pairs detected by the first detecting means or the second detecting means to a user, and generating means for setting one of two images comprising a the image pair selected by the user among the image pairs presented by the presenting means as the image for the left eye and the other as the image for the right eye, and generating the image data for displaying the stereoscopic image.