A system and method for characterizing the relative offset in time between audio and video signals and enables the receiver of the audio and video signals to resynchronize the audio and video signals. Signal characterization data is dynamically captured and encoded into frames of video and audio data that is output by a television origination facility. The signal characterization data is extracted by the receiver and signal characterization data is captured for the received frames. The extracted signal characterization data is compared with the captured signal characterization data to compute the relative offset in time between the video and one or more audio signals for a frame. The receiver may then resynchronize the video and audio signals using the computed relative offset.