The invention is an apparatus and method for estimating an optimized sub-pixel interpolation filter using iterative estimations as needed for sub-pixel motion compensation and motion estimation in a video codec for improving coding efficiency. Multiple iterations of adaptive interpolation filter estimation are performed including more than one iteration based on sub-pixel motion vectors. During testing of the inventive apparatus and method on various video segments, average bit rate reductions were exhibited of approximately 5%.