A method for processing video data in a real-time transport protocol (RTP) payload includes encapsulating video data in a single network abstraction layer (NAL) unit packet for an RTP session. The single NAL unit packet contains a single NAL unit. The method may also include encapsulating decoding order number information in the single NAL unit packet based on at least one of: the RTP session being in a multi-stream transmission (MST) mode, or a maximum number of NAL units that may precede the NAL unit in a de-packetization buffer in reception order and follow the NAL unit in decoding order being greater than 0.