A portable tool sharpener adapted for mounting on a rail such as may be found on various weapons includes a sharpener body in which a plurality of sharpening tools are mounted and a rail-mounting base pivotally mounted to the sharpener body to allow the body to moved selectively to a closed and open position, wherein the rail-mounting base is releasably engageable with a rail mounted on a weapon, a handle or a fixed pad.