An abrasive member for a very high return loss optical connector ferrule is used in abrading an end of an optical connector ferrule having a ferrule hole, in which an optical fiber has been inserted and secured, into a convex spherical surface. The abrasive member comprises a flexible substrate and an abrasive layer, which is formed on the surface of the flexible substrate and comprises a binder and abrasive grains. The surface roughness Ra, expressed in terms of arithmetic mean deviation, of the abrasive layer falls within the range of 0.01 .mu.m to 0.05 .mu.m. The abrasive member carries out polishing such that the surface smoothness of the ferrule surface and the optical fiber surface may be kept high, such that a difference in level between the ferrule surface and the optical fiber surface may not occur, and such that the very high return loss characteristics may thereby be obtained.