A method of encoding a video signal includes selecting a set of base filter kernels from a filter bank; determining a prediction filter parameter based on the set of base filter kernels; performing a filtering of a reference region for a target region based on the prediction filter parameter; and predicting the target region based on the filtered reference region, wherein the prediction filter parameter includes at least one of modulation scalar and partition information.