A system and method of compensating for the effects of the antenna coupling in on-frequency repeaters, whose input and output signals are the same frequency, are disclosed. The repeater is implemented with internal digitally determined compensation that reduces the effect of the antenna coupling, allowing the forward gain of the repeater to be increased. The real and imaginary components of the forward gain are dithered. The change in the power spectrum of the signal in response to the dithering is used to estimate the residual (uncompensated) feedback coupling.