The invention provides a galling mechanism for improving the roughness of a track plate, and belongs to the field of track plate production equipment. The galling mechanism comprises a supporting rod,a connecting rod, an adjusting rod and a galling steel brush, depth adjusting devices and a power device, wherein one end of the connecting rod is fixedly connected with the supporting rod; the otherend of the connecting rod is connected with one end of the adjusting rod through a pin shaft; the other end of the adjusting rod is connected with the galling steel brush; the two ends of the supporting rod are connected with the power device; the depth adjusting devices comprise limiting rods arranged on the two sides of the adjusting rod, adjusting discs, fixing plates and adjusting bolts; theadjusting plates and the supporting rods are oppositely fixed through the fixing plates; a plurality of through holes are formed in each adjusting disc in the circumferential direction; one end of each limiting rod is connected with the adjusting rod; the other end of each limiting rod corresponds to the through holes in the corresponding adjusting disc; and the adjusting bolts are inserted into the corresponding through holes and extends into the limiting rods. The galling mechanism is simple to operate, the galling efficiency is high, the situation that the galling steel brush moves up and down in the galling process is avoided, and the galling depth is uniform and consistent.