A speaker model may implement a direct voltage-to-excursion model in an adaptive filter for modeling the speaker without developing a first electrical-only model and then converting the model to a mechanical model. The voltage-to-excursion model may allow for modeling of different kinds of speakers, such as sealed, ported, or vented speakers. A transfer function may be developed in the adaptive filter for the voltage-to-excursion model, and that transfer function re-used for prediction of excursion values based on an audio signal. Speaker protection may be performed to take steps to prevent speaker damage when a predicted excursion value exceeds safe limits. The voltage-to-excursion model may operate in displacement or displacement-related domains (e.g., velocity and back emf).