A comb filter for use in a video decoder is described. The comb filter includes a line memory for storing as successive pairs of U and V samples of a decoded video signal corresponding to a previous horizontal line of video information and a line memory for storing a second previous horizontal line of video information. The filter also includes a circuit to calculate an average value of both U and V from a previous sample and a corresponding sample from a previous line. The filter also includes a circuit for calculating a correction term for each one of the averages. The correction term is calculated from the opposite color component as was used to calculate the average value.