The present invention relates to a ship anti-collision early warning video detection system and method suitable for navigation marks. The detection system comprises a remote main control unit, a navigation mark remote measurement remote control unit, a communication unit, a vibration monitoring sensor, a video system, a water surface ship identification server and an early warning prompting system. The vibration monitoring sensor is connected with the navigation mark remote measurement remote control unit via the communication unit, the early warning prompting system is connected with the navigation mark remote measurement remote control unit, and the navigation mark remote measurement remote control unit interchanges the information with the remote main control unit. According to the present invention, by combining the actual ship conditions of the navigation channels and the water condition, an efficient and accurate ship anti-collision early warning system is designed, and by utilizing a motion object identification technology based on a Gaussian mixture model, the intelligent monitoring functions of the ship identification and snapshot, the speed analysis, the collision early warning, etc., are realized, and the navigation mark daily supervision and maintenance level can be improved greatly.