[PROBLEM] To enable calculation of motion vectors with a high accuracy by a comparatively simple processing by using a small amount of data without applying a load onto a computer.[MEANS FOR SOLVING PROBLEMS] A motion vector calculation method includes: processing for calculating multi-resolution data up to a predetermined resolution level L from a plurality of inputted image data; and processing for estimating motion vectors per resolution executing a matching step for temporarily calculating motion vectors minimizing an energy function within a predetermined range of the input motion vectors and a smoothing step for finally calculating the motion vectors by averaging the surrounding data. By using the motion vectors of the resolution level L finally calculated as input motion vectors of a further higher resolution level L-1, the processing for estimating motion vectors per resolution is successively repeated on image data of a high resolution, thereby calculating the motion vectors.