A fault diagnosis method for an electrical fused magnesia furnace includes steps of: 1) arranging six cameras; 2) obtaining video information by the six cameras and sending the video information to a control center; then analyzing the video information by a chip of the control center; wherein a multi-view-based fault diagnosis method is used by the chip, comprising steps of: 2-1) comparing a difference between two consecutive frame histograms for shots segmentation; 2-2) computing a set of characteristic values for each shot obtained by the step 2-1), and then computing color, texture, and motion vector information; finally, evaluating shot importance via entropy; 2-3) clustering shots together by calculating similarity; 2-4) generating and optimizing a multi-view video summarization with a multi-objective optimization model; and 2-5) providing fault detection and diagnosis; and 3) displaying results of the fault detection and diagnosis on a host computer inter face of the control center.