The invention relates to a vision assisted bridge crane system, relating to the field of bridge cranes and aiming at solving the problems that an existing bridge crane cannot be accurately aligned at night, in foggy days, in rainy days and under conditions with a poor visual field, and the throughput efficiency of a port is influenced greatly. The vision assisted bridge crane system comprises a bridge crane body, an N-shaft control system, a vision assisted system, a light source and a master control system; the vision assisted system comprises a visible light sensor, a thermal imaging sensor and a variable-focus camera; the master control system comprises an image recognition module, an image locating module, an image measurement module, an image synthesis module and an image processing module; and the master control system also comprises a detection and alarming module connected with the image processing module. According to the vision assisted bridge crane system, the vision assisted system is adopted to locate the bridge crane in an assisted manner, the vision assisted bridge crane system can be used for overcoming the difficulties that the existing vision assisted system cannot work at night, in foggy days, in rainy days and under conditions with the poor visual field, the bridge crane can be used for rapidly grabbing a container and the throughput efficiency of the port is improved greatly.