An apparatus which can polish an entirety of a surface of a substrate, such as a wafer, is disclosed. The apparatus includes a substrate holder configured to hold a substrate and rotate the substrate; and a polishing head configured to rub a polishing tool against a first surface of the substrate to polish the first surface. The substrate holder includes a plurality of rollers which can contact a periphery of the substrate. The plurality of rollers are rotatable about their respective own axes.