A method for encoding a layered video signal with a first layer and a second layer, wherein second layer is dependent on the first layer. The method comprises encoding the first layer and the second layer, wherein at least one of the first layer and the second layer are encoded using neural coding and the first layer is encoded using a first loss function for optimizing a first metric and the second layer is encoded using a second, different, loss function for optimizing a second metric. The method further comprises obtaining decoding parameters for decoding the first layer and the second layer and transmitting and/or storing the encoded base layer and encoded enhancement layer with the decoding parameters.