A mechanism to adjust far-end signal loudness based on environmental noise levels and device speaker characteristics has a noise-level analyzer that receives feedback from an intelligent speaker-boosting logic circuit that provides a signal to a class-D amplifier to drive the speaker. The noise-level analyzer analyzes near-end environmental noise levels and far-end speech input signal levels across critical frequency bands. The noise-level analyzer performs a masking analysis of the far-end and near-end signals, and guides the speaker-boosting logic circuit to apply determined signal boosting levels over selective bands. The speaker-boosting logic circuit monitors system activity along with the selective band boosting guidance from the noise-level analyzer. Using device speaker information and the speaker excursion pattern, the speaker-boosting logic circuit adjusts far-end speech signal loudness without over excursion of the speaker and damage to the speaker hardware.