The invention discloses an optical fiber laser device-based laser removal device for a foreign matter on an overhead line. The laser removal device comprises an optical fiber laser device, a power supply, an optical fiber, a transmitting part and a sighting device, wherein the optical fiber laser device is provided with electricity by the power supply and is connected to the transmitting part through the optical fiber; emitted laser light is transmitted to the transmitting part through the optical fiber; the transmitting part is used for shaping a laser light beam into a quasi parallel light beam or a convergent light beam with a focal length for outputting; and the sighting device and the transmitting part are arranged in parallel and are used for remotely observing and sighting the foreign matter. The other auxiliary equipment is not needed, the risks of tower climbing, high-altitude operation and near-field operation under a high voltage condition of an operator are omitted, the operation is simple, the removal efficiency is high and a lot of manpower and material resources can be saved.