Methods and systems for image encoding and decoding are disclosed. According to some embodiments, scene metadata and input images associated with a scene are received. A first encoding operation is performed on the scene metadata and input images to generate reference images and reference disparity information. A second encoding operation is performed on the reference images and reference disparity information to output encoded data. The encoded data includes encoded reference images and encoded reference disparity information. The encoded data is transmitted.