A displacement measurement device includes: an obtainer that obtains a first image which contains a subject and a second image which contains the subject; a generator that generates M template images which contain the subject and which have noise from the first image and generates M target images which contain the subject and which have noise from the second image, M being an integer of 2 or higher; a hypothetical displacement calculator that calculates M hypothetical displacements of the subject from the M template images and the M target images; and a displacement calculator that calculates a displacement of the subject by performing statistical processing on the M hypothetical displacements.