A communication device (400) with a polarization diversity antenna configuration, having a first antenna (410) with a first plane of polarization and a second antenna (412) with a second plane of polarization. Signal strength of a demodulated signal when the antenna switch (420) is coupled to one of the antennas (410, 412) is measured by a signal strength measuring circuit (440) to generate a short-term average signal power (SA) representing signal strength over a first predetermined number of symbol periods, a medium-term average signal power (MA) representing signal strength over a second predetermined number of symbol periods, and a long-term average signal power (LA) representing signal strength over a third predetermined number of symbol periods, greater than the second predetermined number of symbol periods and first predetermined number of symbol periods. Switching between antennas (410, 412) is made in response to differences between SA, MA and LA.