The invention relates to a method of controlling decoder drift for memory compression comprising the steps of providing a decoded bit-stream output of a decoder (79) and a bit-stream input to an encoder (76) in a first pass of a coding loop, where the bit-stream input to the encoder (76) is based on the decoded bit-stream output of the decoder (79), determining a difference between the bit-stream input to the encoder (76) and the decoded bit-stream output of the decoder (79), where the difference is due to a compression of the decoded bit-stream output of the decoder (79) in the encoder (76) during the first coding loop and correcting the decoded bit-stream output of the decoder (79) in dependence on the determined difference in a second pass of the coding loop.