Provided is a method of decoding an image, the method including: determining at least one prediction unit included in a current frame that is one of at least one frame forming the image; determining a reference region to be referred to by a current prediction unit that is one of the at least one prediction unit; changing a sample value included in at least one of the current prediction unit and the reference region, based on an analyzing result of a sample value of the reference region; determining a sample value included in the current prediction unit, based on a result of changing the sample value; and decoding the image based on the determined sample value of the current prediction unit.