A method for cross-color Intra prediction using the LM Intra mode using multi-row or multi-column neighboring reconstructed pixels for LM parameter derivation or using only top pixels or left pixels of neighboring pixels is disclosed. Multiple LM Intra modes can be used. For example, three LM Intra modes can be used and the LM parameters for the three LM Intra modes can be determined based on only the top pixels, only the left pixels and both the top pixels and left pixels of neighboring reconstructed pixels respectively. To remove the need for additional buffer requirement for deriving the LM parameters based on using multi-row or multi-column neighboring reconstructed pixels, the current method re-uses existing buffers, where the buffers are used for deblocking. A syntax element can be used to indicate one of the multi-LM modes selected.