An image rejection (IR) circuit is configured to receive a complex signal from a radio frequency (RF) mixer, where the complex signal includes an in-phase signal portion and a quadrature signal portion. This IR circuit may include: an in-phase path to remove first mismatch information from the in-phase signal portion and associated with at least one in-phase multi-tap filter; a quadrature path to remove second mismatch information from the quadrature signal portion and associated with at least one quadrature multi-tap filter; and a correlation unit to independently update each of the multiple taps of the in-phase multi-tap filter and the quadrature multi-tap filter according to a priority scheme.