A coaxial connector assembly includes an inner contact terminating a center conductor of a coaxial cable, an insulator holding the inner contact, and an outer contact, which surrounds the insulator and the inner contact, terminating a shield braid of the cable. The outer contact is formed into a barrel shape and includes a seam extending along an entire length of the outer contact. The coaxial connector assembly further includes an outer ferrule and a seamless inner ferrule. The seamless inner ferrule has a first ferrule portion with a first diameter and a second ferrule portion with a second diameter that is different from the first diameter. The first ferrule portion surrounds at least a portion of the outer contact. The shield braid is sandwiched between the second ferrule portion and the outer ferrule. A method of manufacturing the coaxial connector assembly is also provided.