The present invention discloses an omnidirectional fault automatic identification method of an isolation switch. The visible light image information and infrared detection image information are collected through each direction of the isolation switch, then the corresponding image information is subjected to preprocessing, the algorithm fusion is carried out, the feature point extraction and description are carried out and a description vector is generated, then the description vector is subjected to feature matching, a wrong matching feature point is eliminated, an identification area and the coordinate of an edge point are determined, the obtained edge point is subjected to affine transformation are is marked in the infrared fusion image of the isolation switch, thus the automatic identification of the isolation switch infrared fusion image is completed, the template image of the isolation switch is subjected to mode identification, and thus whether the isolation switch has a fault or not is judged. According to the method, the defect in current isolation switch fault detection technology is solved, and the method has the advantages of non-contact precise identification, isolation switch component comprehensive identification and fully automatic fault detection and identification.