An image processing apparatus and a method implemented by the image process apparatus generates a vertical disparity map through regression analysis, based on a difference between vertical coordinate values from feature correspondence information of left and right source images. A geometric difference through image warping is calibrated before depth information is restored through depth estimation. Thus, a process of optimizing a camera model may not have to be performed, and occurrence of black areas that may be caused by image rotation may be reduced.