From a plurality of medical images in time phases, a target site is extracted from at least one medical image, a reference point is set on each of a target-site side, and a periphery side of the target site which are on across from each other over an outline of the extracted target site, and movement information for the reference points is calculated.