An image shake detecting device for detecting a shake of an image on an image sensing plane on the basis of a video signal output from an image sensor includes detection circuits arranged to detect image displacement in a plurality of areas set on the image sensing plane, and a control microcomputer which makes a discrimination, on the basis of information output from these detection circuits, between a movement of a camera and a solo movement of a photographed object. The device thus accurately makes compensation for an image shake by judging the state of the image on the basis of information output from these detection circuits. The image shake detecting device further includes a computing circuit arranged to compute a quantity of an image shake on the basis of a difference in detecting timing of a feature point of the image and a sensitivity control circuit arranged to change the detection sensitivity of the shake detection circuits. Further disclosed is an object tracing device to which the invented image shake detecting device is applied.