A method of a first communication device for removing a self-interference signal in a wireless communication system is provided. The method includes receiving a signal having a size less than a first threshold value from a second communication device in a first interval within a first frame, transmitting a first signal to a third communication device in the first interval, and estimating a self-interference channel through which the self-interference signal is transmitted based on the signal received in the first interval and the first signal transmitted in the first interval. The self-interference signal is a signal transmitted by the first communication device and is received by the first communication device through the self-interference channel.