Disclosed are an apparatus and a method of cancelling an echo signal flowing in a microphone of an electronic device. The electronic device may include: a microphone configured to receive a sound signal; an Application Processor (AP) configured to execute an application; a communication module configured to control a voice call service; a speaker configured to output a sound signal; an audio processing module configured to process an output of at least one of an audio signal received from the AP, a voice signal received from the communication module, or a combined signal to the speaker; a first Acoustic Echo Canceller (AEC) configured to cancel an echo of the sound signal received through the microphone based on the output from the audio processing module and provide the signal to the AP, the first AEC being located in at least one of the AP, the audio processing module, and an external pre-processing module; and a second AEC configured to cancel an echo of the sound signal received through the microphone based on the output from the audio processing module and provide the signal to the communication module, the second AEC being located in at least one of the communication module, the audio processing module, and the external pre-processing module. Other embodiments may be possible.