A method, system and processor-readable medium for automatically detecting anomalies at a traffic intersection. A set of clusters of nominal vehicle paths and a set of clusters of nominal trajectories within the nominal vehicle paths can be derived in an offline process. A set of features within each nominal trajectory among the set of clusters of nominal trajectories can be selected. A probability distribution for features indicative of nominal vehicle behavior within the nominal trajectories can be derived. An input video sequence can be received and presence of the anomaly in the vehicle path, trajectories and features within the input video sequence can be detected utilizing the derived path clusters, trajectory clusters, and feature distributions.