A user equipment device (UE) determines a beam coherence interval metric, which is a measure of stability of a beam pair over time based on a set of beam coherence intervals measured by the UE. The beam pair comprises a receive beam of the UE and a transmit beam of a base station transmitting to the UE. A beam coherence interval comprises a time duration within which a quality of a signal received on the UE receive beam remains within one of a plurality of signal quality bins. The UE also determines a hysteresis value based on the beam coherence interval metric and uses the hysteresis value to decide to switch from an active receive beam to a different receive beam that has a signal quality higher than the active receive beam by at least the hysteresis value. Alternatively, the base station determines and sends the UE the hysteresis value.