Encoding and decoding an image may be performed by setting a plurality of segments of a second color component block based on pixel values of a first color component block. The plurality of segments may be predicted by using different context pixels, and the second color component block may be encoded and decoded based on the predicted plurality of segments.