Techniques are described in which a video coder is configured to determine, using one or more characteristics of an interpolation filter, a number of reference samples to be stored at a reference buffer. The video coder is further configured to generate a plurality of values corresponding to the number of reference samples in the reference buffer. The video coder is further configured to generate prediction information for intra-prediction using the interpolation filter and the plurality of values. The video coder is further configured to reconstruct the block of video data based on the prediction information.