Methods and apparatus for intra prediction in video encoding and decoding using a composite reference array are described. In one exemplary embodiment, the composite reference array is formed from two or more reference arrays of a plurality of reference arrays. The composite reference array can be formed by projecting along a prediction direction, one or more of the plurality of reference arrays onto a reference array closest to the block of the video data being encoded or decoded. The filter coefficients for the interpolation filter are then determined based on the locations of the predictors on different reference arrays. Interpolating reference samples from different reference arrays, the predictor value for a target sample can be obtained.