An anti-noise signal is produced in accordance with an active noise cancellation process (ANC), at an input of a speaker so as to control how much background noise a user can hear. Strength of the anti-noise signal is adjusted gradually, rather than abruptly, in proportion to decreasing or increasing sound pressure level (SPL) of the background noise, during inactivation or activation of the ANC process. Other embodiments are also described and claimed.