Techniques are described for identifying and reducing the incidence of artifacts in video using color gamut scalability (CGS) parameters and tables in scalable video coding (SVC). Derivation of CGS mapping tables are performed for each partition of pixel values in a color space. The pixel value domain is split into partitions and each is optimized independently. Color prediction techniques for CGS may be used by video encoders and/or video decoders to generate inter-layer reference pictures when a color gamut for a lower layer of video data is different than a color gamut for a higher layer of the video data. When mapped values are used as inter-layer predication references for the enhancement layer blocks, artifacts may appear in some frames of the sequences. A video encoder may identify blocks that potentially contain these artifacts and disable inter-layer prediction in those identified blocks.