The invention discloses a traffic intersection simulating command system based on vision. The system comprises a first video surveillance device, a first traffic light, a second video surveillance and a second traffic light, the first video surveillance device and the first traffic light are arranged on a first traffic intersection, and the second video surveillance device and the second traffic light are arranged on a second traffic intersection adjacent to the first traffic intersection. The communication end of the first video surveillance device and the communication end of the second video surveillance device are connected with a first communication end of a central processing module through a communication module, the second communication end of the central processing module is connected with the communication end of a signal processing module, the third communication end of the central processing module is connected with the signal input end of a traffic light control module, and the first signal output end and the second signal output end of the traffic light control module are connected with the signal input end of the first traffic light and the signal input end of the second traffic light respectively. Compared with a traditional modification vehicle detector, the system is lower in scheme cost, convenient to implement and high in automation degree.