The invention discloses a grinding and removing device for impurity scraps on the surface of steel. The device comprises a support, a handle and a grinding disk. The support is provided with a grinding motor used for being connected with the grinding disk. A rotating column rod is arranged on the middle portion of the support. The support is provided with a grinding supporting plate. A rotating connection plate is arranged between the grinding supporting plate and the handle. The middle portion of the rotating connection plate is arranged on the rotating column rod. The grinding motor and the grinding disk are arranged at one end of the rotating connection plate. The support is further provided with an annular concave cavity with an opening formed in the top face. In the annular concave cavity, arrangement is performed with the rotating column rod as the center; a height adjusting ring is arranged in the annular concave cavity; a vertical cylinder is arranged between the height adjusting ring and the annular concave cavity; a buffering pressing spring is arranged between the height adjusting ring and the bottom wall of the annular concave cavity; the bottom face of the rotating connection plate is pressed on the height adjusting ring in an abutting manner; and a grinding pressure disk is fixedly arranged on the bottom face of the rotating column rod. The grinding and removing device for the impurity scraps on the surface of steel is simple in structure, convenient and fast to operate, good in using stability, high in universality and good in practicability.