A method for generating an alert signal in a surveillance system comprising: detecting a targeted individual in a video stream, selecting the targeted individual, and tracking the targeted individual, as first steps. The method also comprises classifying actions of the detected individual over a plurality of image frames in the video stream in response to the identification of the detected object as being a targeted person, and generating an alert signal if the classified action of the object is classified as a predefined alert-generating action.