An interframe coding system which eliminates higher frequency components contained in an image signal effectively and adaptively with an adaptive filter provided in a coding loop. The adaptive filter eliminates the higher frequency components with the optimal filtering intensity for an image signal specified with a filtering coefficient which is decided by a filter controller. The filtering coefficient is decided by normalization of the difference between an input image signal and a predictive signal from a frame memory by the "Activity" of the input image signal or the predictive signal. The "Activity" can be based upon the sum of the absolute or squared difference values based upon the mean value of luminance intensity of pixels of the image signal.