Video data with enhanced dynamic range (EDR) are color graded for a first and a second reference display with different dynamic range characteristics to generate a first color-graded output, a second color graded output, and associated first and second sets of metadata. The first color-graded output and the two sets of metadata are transmitted from an encoder to a decoder to be displayed on a target display which may be different than the second reference display. At the receiver, a decoder interpolates between the first and second set of metadata to generate a third set of metadata which drives the display management process for displaying the received video data onto the target display. The second set of metadata of metadata may be represented as delta metadata values from the first set of metadata values.