An abnormality diagnosis device includes a partially-plugged filter, a pressure difference sensor, a PM sensor, a first estimation portion estimating a diagnosis amount of PM from the partially-plugged filter, according to a running condition of the internal combustion engine, a second estimation portion estimating the diagnosis amount of PM according to an output of the pressure difference sensor, a third estimation portion estimating the diagnosis amount of PM according to an output of the PM sensor, and an abnormality diagnosis portion distinctly determining an abnormality of the internal combustion engine, an abnormality of the partially-plugged filter, and an abnormality of the PM sensor by comparing the diagnosis amount of PM estimated by the first estimation portion, the diagnosis amount of PM estimated by the second estimation portion, and the diagnosis amount of PM estimated by the third estimation portion.