Techniques and tools for signaling for fading compensation in video processing applications are described. For example, a video encoder performs fading compensation on a reference image, signals that fading compensation is used, and signals fading parameters for the fading compensation. A video decoder receives the signaled information and performs fading compensation on the reference image according to the fading parameters.