An image processing apparatus includes a unit configured to calculate a sum of absolute differences between pixel values of pixels in a block of interest and pixel values of pixels in a reference block, a unit configured to compare sums of absolute differences calculated and to determine a minimum sum of absolute differences thereamong, a unit configured to estimate a motion vector for the pixel of interest using the reference pixel having the minimum sum of absolute differences and the pixel of interest, a unit configured to generate a motion-compensated image by using pixel values of the pixels as pixel values of corresponding pixels in the motion-compensated image, a unit configured to cumulatively add sums of absolute differences, and a unit configured to generate an interpolation image by mixing the pixels and corresponding pixels in the motion-compensated image according to an obtained cumulative-sum result.