In a video processing system (14), a method of detecting and compensating for motion of an image which includes the steps of: detecting a first pixel value, a second pixel value, and a third pixel value, the first pixel value of a first scan line in a first field, the second pixel value of a second scan line in the first field, and the third pixel value in a second field; providing a motion indicator based on the first, second, and third pixel values; selecting a plurality of interpolation coefficients from a memory based on the motion indicator signal; and providing an interpolated color space pixel based on a first color space pixel associated with the first pixel value, a second color space pixel associated with the second pixel value, and based on the plurality of interpolation coefficients.