Disclosed herein is an echo removing apparatus including: a sound input terminal configured to input an external sound signal from external equipment; a first echo removing device configured to, after admitting as input signals the external sound signal coming from the external equipment and input through the sound input terminal and a receiver sound signal transmitted from a calling party, estimate a first pseudo echo component from the external sound signal in order to remove the first pseudo echo component from the receiver sound signal; and a second echo removing device configured to, after admitting as input signals the external sound signal coming from the external equipment and input through the sound input terminal and a transmitter sound signal input from a microphone, estimate a second pseudo echo component from the external sound signal in order to remove the second pseudo echo component from the transmitter sound signal.