A distance measurement device includes an imaging optical system, an imaging unit, an emission unit, a derivation unit which performs a distance measurement to derive a distance to a subject based on a timing at which directional light is emitted by the emission unit and a timing at which reflected light is received by a light receiving unit, a shake correction unit which performs shake correction as correction of shake of the subject image caused by variation of an optical axis of the imaging optical system, and a control unit which performs control such that the shake correction unit does not perform shake correction or performs shake correction with a correction amount smaller than a normal correction amount determined in advance in a case of performing the distance measurement and performs shake correction with the normal correction amount in a case of not performing the distance measurement.