An acoustic echo cancellation device for generating a pseudo echo signal by filtering an input remote speaker signal based on a plurality of adaptive filters and controlling the adaptive filters to filter the same based on a filter coefficient. The acoustic echo cancellation device generates an error signal by subtracting the pseudo echo signal from a nearby speaker signal, determines a convergence state of the filter coefficient based on the error signal, and sets at least one filter coefficient with a previously used value to stop the operation for calculating new values for the corresponding filter coefficients when the filter coefficient is determined to be converged.