A system and method for implementing an adaptive interpolation filter structure that achieves high coding efficiency with significantly less complexity than more conventional systems. In various embodiments, a set-of integer pixels are defined that are used in the interpolation process to obtain each sub-pixel sample at different locations. Samples at each sub-pixel positions are generated with independent pixel-aligned one-dimensional (1D) adaptive interpolation filters. The filter coefficients are be transmitted to a decoder or stored into a bit stream. At the decoder end, the received filtered coefficients may be used in an interpolation process to create a motion-compensated prediction.