A perpendicular plug connector has an insulative housing, multiple first conductive terminals, multiple second conductive terminals, a base, a reinforcing fastening element and a shell. The first conductive terminals and the base are mounted on the insulative housing. The reinforcing fastening element is mounted on and tightly abutting the base. The shell accommodates the insulative housing and the first conductive terminals. The reinforcing fastening element allows fasteners such as bolts and rivets to extend through and fasten the perpendicular plug connector securely on a circuit board and enhances structural strength of the base.