For time synchronization of a data stream with multi-channel additional data and a data stream with data on at least one base channel, a fingerprint information calculation is performed on the encoder side for the at least one base channel to insert the fingerprint information into a data stream in time connection to the multi-channel additional data. On the decoder side, fingerprint information are calculated from the at least one base channel and used together with the fingerprint information extracted from the data stream to calculate and compensate a time offset between the data stream with the multi-channel additional information and the data stream with the at least one base channel, for example by means of a correlation, to obtain a synchronized multi-channel representation.