The invention relates to a parametric audio encoder, comprising a parameter generator, the parameter generator being configured to determine a first set of encoding parameters and reference audio signal values, wherein the reference audio signal is another audio channel signal or a downmix audio signal derived from at least two audio channel signals of the plurality of multi-channel audio signals, to determine a first encoding parameter average based on the first set of encoding parameters of the audio channel signal, to determine a second encoding parameter average based on the first encoding parameter average of the audio channel signal and at least one other first encoding parameter average of the audio channel signal, and to determine the encoding parameter based on the first encoding parameter average of the audio channel signal and the second encoding parameter average of the audio channel signal.