An optical ferrule assembly is disclosed. The optical ferrule assembly comprises a ferrule body, a notch part, a retainer and an annular member. The ferrule body includes an optical fiber loading hole extending therethough in a longitudinal direction. The notch part is formed in the ferrule body and has a flat surface which receives the optical fiber loading hole. The retainer is arranged in the notch part and has a lower abutting surface opposing to the flat surface and an inclined abutting surface formed on one end side of the lower abutting surface. The annular member fits on an outer periphery of the ferrule body. When the annular member is brought into contact with a portion of an outer peripheral surface of the retainer on one end side thereof, the inclined abutting surface is opposed to the flat surface, and the lower abutting surface is inclined to the flat surface and separated from the flat surface. When the annular member is brought into contact with the whole of the outer peripheral surface of the retainer, the inclined abutting surface is inclined to the flat surface and separated from the flat surface, and the lower abutting surface is opposed to the flat surface.