The coaxial cable connector according to the invention includes a male connector having a male terminal assembly that connects to a female connector having a female terminal assembly during coupling between the male connector and the female connector. Each of the male and female terminal assemblies includes a catching protrusion, while each connector includes an elastic plate formed at a top of an receiving passageway. The elastic plate includes a catching hole in which the corresponding catching protrusion is caught. Each male and female terminal assemblies includes a groove formed at a side thereof, while the male and female connectors include a fixing piece formed at a side of the receiving passageway thereof. The fixing piece fits in the corresponding groove through a side of a corresponding one of the male and female connectors, whereby the male and female terminal assemblies are dually fixed to the male and female connectors.