A method for video processing is provided. The method includes performing downsampling on chroma and luma samples of a neighboring block of the current video block; determining, for a conversion between a current video block of a video that is a chroma block and a coded representation of the video, parameters of cross-component linear model (CCLM) based on the downsampled chroma and luma samples obtained from the downsampling; applying the CCLM on luma samples located in a luma block corresponding to the current video block to derive prediction values of the current video block; and performing the conversion based on the prediction values.