A shake correction device includes: a first driving means for driving an imaging component, which is related with either an imaging optical system or an imaging device, in a first direction; a second driving means for driving the imaging component in a second direction which is different from the first direction; and a control means for correcting shake of the imaging apparatus by driving the imaging component on the basis of a detection result of the shake of the imaging apparatus, which is obtained by a shake detection means, using the first and second driving means, wherein the control means sequentially executes first return processing in the first direction using the first driving means and second return processing in the second direction using the second driving means when returning the imaging component to a reference position at a predetermined timing.