Encoding of Higher Order Ambisonics (HOA) signals commonly results in high data rates. A method for low bit-rate encoding frames of an input HOA signal having coefficient sequences comprises computing (s110) a truncated HOA representation (CT(k)), determining (s111) active coefficient sequences (Ic,Act(k)), estimating (s16) candidate directions (MDIR(k)), dividing (s15) the input HOA signal into a plurality of frequency subbands (f1, . . . , fF), estimating (s161) for each of the frequency subbands a subset of candidate directions (MDIR(k)) as active directions (MDIR(k,f1), . . . , MDIR(k,fF)) and for each active direction a trajectory, computing (s17) for each frequency subband directional subband signals from the coefficient sequences of the frequency subband according to the active directions, calculating (s18) for each frequency subband a prediction matrix (A(k,f1), . . . , A(k,fF)) that can be used for predicting the directional subband signals from the coefficient sequences of the frequency subband using the respective active coefficient sequences (Ic,ACT(k)), and encoding (s19) the candidate directions, active directions, prediction matrices and truncated HOA representation.