A system having a transmitter and a receiver provides sign language video data in a broadcasting-communication convergence system. A transmitter extracts data, to which a sign language is to be applied, from the multimedia data, converts the extracted data into motion data, converts the motion data into an avatar motion schema indicative of avatar motion data, converts the avatar motion schema into metadata, multiplexes the multimedia data and the metadata, and transmits the multiplexed data. A receiver receives the multiplexed data, demultiplexes the received multiplexed data, extracts an avatar motion schema using the metadata, generates sign language video data by controlling a motion of an avatar through the avatar motion schema, multiplexes the sign language video data and the multimedia data, and transmits the multiplexed data to a display unit.