Systems, devices and methods for performing luma-based chroma ultra prediction are described. Down-sample filters may be applied to luma values of luma pixel positions to generate reconstructed luma values for chroma pixel positions in a prediction unit of an intra frame. The down-sampled reconstructed luma values may then be used to predict chroma values for the chroma pixel positions. In some implementations, a reconstructed luma value of a chroma position may be used to predict that position's chroma value. In other implementations, reconstructed luma values of neighboring chroma pixel positions may be analyzed to adaptively predict a chroma value for a chroma pixel position.