A method of decoding video data includes predicting luma samples for a block of the video data using matrix intra prediction (MIP), where using MIP comprises down-sampling a set of luma neighboring samples to generate down-sampled luma neighboring samples. The method further includes predicting chroma samples for the block using cross-component linear model (CCLM) prediction, where using CCLM prediction comprises predicting the chroma samples for the block based on the down-sampled luma neighboring samples generated from the MIP. The method further includes determining a prediction block for the block based on the luma samples and the chroma samples, decoding a residual block for the block, and combining the prediction block and the residual block to decode the block.