A method of manufacturing an optical connector according to the invention includes: holding a first optical fiber by a pair of holding members at a position apart from an end face of a second end and through both sides thereof in a radial direction, the first optical fiber being provided with a solid refractive index-matching material layer, the refractive index-matching material layer being formed on the end face of the second end on an opposite side of an end face of a first end exposed to a front end of a ferrule; and inserting the first optical fiber into a fiber hole of the ferrule through the first end.