According to an embodiment of the disclosure, a system for controlling an emergency bell based on sound comprises an emergency bell device installed in a crime area, gathering sound information generated in the crime area, detecting an emergency event from the gathered sound information, and generating an emergency bell operation signal, an analysis server receiving, in real-time, the sound information from the emergency bell device if the emergency bell operation signal is received, classifying per-time key sound sources in the sound information, and providing a situation analysis result on whether a crime occurs using the classified per-time key sound sources, and a control server receiving the situation analysis result and providing on-site dispatch information or situation response information to a security terminal in charge of the crime area based on the received situation analysis result.