An echo canceller for improved recognition and removal of an echo from a communication device. The echo canceller can dynamically reduce echo using an improved energy estimator and an improved adaptive filter. The improved energy estimator can determine if conversation is in a single talk period or a double talk period based on the combined energy of both the near end background noise and speech. The improved adaptive filter can reduce echo by dynamically changing adaptation speed or step size. In double talk, the adaptive filter(s) can dynamically slow-down or stop adaptation. In single talk, the filter can dynamically increase the speed of adaptation to improve accuracy, or decrease adaptation speed for stability.