The appearance of image details can be preserved and/or enhanced by applying contrast adaptive gain to the high spatial frequency component of the luminance information. The image details in bright and/or dark regions can be further boosted by applying a local mean adaptive gain. The contrast transfer mapping curve for luminance contrast enhancement can be re-scaled to account for the applied gain. The re-scaling may be performed from frame to frame of displayed video. The re-scaling may be temporally controlled for subsequent frames to make the re-scaling change gradually to prevent flickering.