A magnetic recording medium comprises a magnetic layer containing a ferromagnetic powder, a binder and an abrasive material having a Mohs hardness of 8 or more on a non-magnetic support, wherein the average protrusion height, which represents the length between the central line of the surface roughness of the sectional curve of the magnetic layer and the upper end of the abrasive material existing (i) above the central line of the surface roughness of the magnetic layer and (ii) in the surface layer of the magnetic layer, is 15 nm or less. A process for preparing the magnetic recording medium comprises coating on a non-magnetic support a magnetic layer containing a ferromagnetic powder, a binder and an abrasive material having a Mohs hardness of 8 or more, and then polishing the surface of the magnetic layer with an abrasive tape, wherein as the abrasive tape there is used one containing at least one abrasive material having a higher Mohs hardness than the abrasive material to be incorporated in the magnetic layer.