The present invention relates to a system and a method for window open alarm detection based on image recognition. The system comprises: an image collection module configured to collect a video imagecomprising a window; an image preprocessing module configured to perform color space conversion of the video image and convert a RGB image to an HSI image; a window open detection module configured todetermine a window open alarm position according to brightness component image data in the HSI image; and a display control module configured to display the window open alarm position. The collectedvideo image is converted to the HSI image, and the brightness component image data in the HSI image is recognized to achieve detection and alarm location of window open behaviors of a building and achieve effective monitoring and danger early warning of buildings around a key area.