A movement evaluation apparatus extracts feature points from a first reference object image and an ideal object image which are obtained by sensing an image including an object by an image sensing unit, and generates ideal action data on the basis of change amounts of the feature points between the first reference object image and the ideal object image. The apparatus extracts feature points from a second reference object image and an evaluation object image sensed by the image sensing unit, and generates measurement action data on the basis of change amounts of the feature points between the second reference object image and the evaluation object image. The movement evaluation apparatus evaluates the movement of the object in the evaluation object image on the basis of the ideal action data and the measurement action data.