An image processing apparatus may include an image frame determiner to determine one standard image frame and at least one reference image frame using light field data about a scene, a point spread function determiner to determine a point spread function based on sub-pixel displacement between the standard image frame and the at least one reference image frame, an image interpolator to interpolate the standard image frame into a high-resolution standard image frame having a higher resolution than the standard image frame, and an image restorer to restore a high-resolution image by updating the high-resolution standard image frame using the generated high-resolution standard image frame, the point spread function, and the at least one reference image frame.