Packetized video data with a base-layer and at least one enhancement-layer organized in a GOP structure may contain packet loss errors. A method for detecting such errors includes the steps of reading header information relating to a layer, generating a scheme or selecting a predefined scheme according to the header information. The scheme can be made up of a display order number, and/or a number of reference frames and temporal level for the frames of the respective layer. The method can then extract from received video data frames the display order number, and/or the number of reference frames and temporal level parameters, and detect that one or more frames or packets are missing. The received parameters are compared with the parameters of expected frames according to the scheme and a missing packet or frame is determined by a mismatch between received and expected parameters.