Packetized video data with a base-layer and at least one enhancement-layer organized in a GOP structure may contain packet loss errors. A method for detecting such errors comprises the steps of reading header information relating to a layer, generating a scheme or selecting a predefined scheme according to said header information, the scheme comprising display order number, number of reference frames and temporal level for the frames of the respective layer, extracting from received video data frames display order number, number of reference frames and temporal level parameters, and detecting that one or more frames or packets are missing, wherein the received parameters are compared with the parameters of expected frames according to said scheme and a missing packet or frame is determined by a mismatch between received and expected parameters.