Personal speaker systems including headset and earbud systems may be configured to capture audio data using an in-ear microphone while a speaker outputs known audio signals into the ear canal. The system may generate an acoustic model of the compressed ear canal and ear drum of the listener and utilize the acoustic model to provide noise cancellation at the eardrum, modification to the audio to result in a more natural sound at the eardrum, and/or to measure leakage of the personal speaker system.