An image processing apparatus includes an estimation unit configured to estimate an image generation pixel value corresponding to a position of a phase difference detection pixel of an image element, based on a determination pixel value of image data including the determination pixel value and the image generation pixel value as image data generated by the imaging device including the phase difference detection pixel for generating the determination pixel value for making a focus determination and an image generation pixel for generating the image generation pixel value for generating an image, and an interpolation unit configured to interpolate image generation pixel values of pixels configuring the image data based on the estimated image generation pixel value and the image generation pixel value generated by the image generation pixel.