The invention discloses a video scene detection method. According to the method, video data is detected by a computer instead of artificial detection, and scenes in the video are recognized. The detection method includes an offline training discrimination model process and a video scene detection process. The offline training discrimination model process includes: centralizing each video extraction feature comprising semantic and space-time feature extraction aiming to training video samples; performing category annotation of feature vectors and obtaining a group of sample set; performing iteration training of the sample set by employing a multiple-kernel learning frame and obtaining an offline training model. The video scene detection process includes: accessing to a monitoring video source; performing video sampling and obtaining a short video; extracting features from the short video; and loading the offline training model, detecting the features, and obtaining a detection result. According to the method, the scenes in the video can be recognized by the computer instead of artificial detection, the detection efficiency can be improved, the cost is lowered, and convenience is brought to data storage and retrieval.