Presented herein are techniques for exploiting correlations between channels of an image or video frame to be encoded. The correlations between channels in an initial prediction are used to calculate the mapping. The method also determines whether the new prediction is an improvement over the original prediction if no extra signaling is to be used. The method may significantly improve the compression efficiency for images or video containing high correlations between the channels.