Systems and methods are disclosed for dynamically adjusting the backlight of a display during video playback or for generating filtered video metadata. Given an input video stream and associated metadata values of minimum, average, or maximum luminance values of the video frames in the video stream, values of a function of the frame min, mid, or max luminance values are filtered using a temporal filter to generate a filtered output value for each frame. At least one filtering coefficient of the temporal filter is adapted based on a logistic function controlled by slope and sensitivity values. The instantaneous dynamic range of a target display is determined based on the filtered metadata values and the minimum and maximum brightness values of the display.