An image processing device includes: a motion vector receiving unit configured to receive, from frame image data made up of frame images, motion vectors representing motion of the frame images; a modeling unit configured to model the motion vector, received from the motion vector receiving unit, to a component separation expression in which a camera motion component and a focal plane distortion component are separated, using component parameters respectively representing camera motion which is motion of a camera, and the amount in change in focal plane distortion; and a component calculation unit configured to calculate the component parameters used in the component separation expression, thereby calculating the focal plane distortion component in the motion vector.