A high speed connector includes a male connector portion and a female connector portion. The male connector portion includes a male-portion housing and high-speed male terminals and other male terminals received in the male-portion housing. The female connector portion includes a female-portion housing and high-speed female terminals and other female terminals received in the female-portion housing. The high-speed male and female terminals both include a fixing section for fixing the terminals in the respective housings. The high-speed male and female terminals both include flat-structured terminals and deviated-structured terminals. The fixing section of the the flat-structured terminal is located on the same plane as other sections of the terminal, while the fixing section of the deviated-structured terminal is deviated sidways with respect to the other sections. Such an alternating arrangement allows the connector to be minatruized and interference and loss of signals transmitted therethrough are reduced.