A method and system that reduces the impact of packet loss on video data quality. Packet selection is performed by the method and system to selectively drop low priority packets so that the overall quality of the received video data may be improved. In one exemplary embodiment, the probability of higher priority layers being delivered on time is computed and a packet is transmitted only if this probability is greater than a given threshold h. In another exemplary embodiment, the system and method have the capability of backing up the process to transmit previously skipped packets, if time allows.