Provided are an apparatus and method for stably correcting handshake that occurs during a camera panning situation. In the method, movement information is accumulated by a predetermined unit for a predetermined period of time. A regression model is matched to the accumulated movement information so as to determine a situation as one of a panning mode and a handshake mode. Switching is performed between the handshake mode and the panning mode according to the size of a matching factor generated by the matched regression model. Handshake is corrected on the basis of a handshake correcting amount determined according to one of the handshake mode and the panning mode.