An adaptive noise canceling (ANC) circuit adaptively generates an anti-noise signal from a reference microphone signal that is injected into the speaker or other transducer output to cause cancellation of ambient audio sounds. An error microphone proximate the speaker provides an error signal. A secondary path estimating adaptive filter estimates the electro-acoustical path from the noise canceling circuit through the transducer so that source audio can be removed from the error signal. Tones in the source audio, such as remote ringtones, present in downlink audio during initiation of a telephone call, are detected by a tone detector using accumulated tone persistence and non-silence hangover counting, and adaptation of the secondary path estimating adaptive filter is halted to prevent adapting to the tones. Adaptation of the adaptive filters is then sequenced so any disruption of the secondary path adaptive filter response is removed before allowing the anti-noise generating filter to adapt.