A hand-off monitoring method is provided for monitoring a space divided into several monitoring regions. Each of the monitoring regions is monitored by a surveillance camera. The hand-off monitoring method comprises receiving a warning signal from a location and identifying a first surveillance camera related to the location according to the warning signal. Then, an object triggering the warning signal is identified according to a video signal provided by the first surveillance camera. A moving path of the object is predicted according to a non-linear movement prediction model. Then, a control operation is performed, according to the moving path, to control the surveillance cameras in the monitoring regions where the moving path passes so as to hand-off monitor the object.