An acoustic interference cancellation system that combines acoustic echo cancellation and an adaptive beamformer to cancel acoustic interference from an audio output. The system uses a fixed beamformer to generate a target signal in a look direction and an adaptive beamformer to generate noise reference signals corresponding to non-look directions. The noise reference signals are used to estimate acoustic noise using an acoustic interference canceller (AIC), while reference signals associated with loudspeakers are used to estimate an acoustic echo using a multi-channel acoustic echo canceller (MC-AEC). The system cancels the acoustic echo and the acoustic noise simultaneously by adding the estimate of the acoustic noise and the estimate of the acoustic echo to generate an interference reference signal and cancelling the interference reference signal from the target signal. The system jointly updates adaptive filters for the AIC and the MC-AEC logic to improve a robustness of the system.