Systems, methods and apparatus for encoding or decoding a file format that stores one or more images are described. One example method includes performing a conversion between a visual media file and a bitstream of a visual media data according to a format rule, where the format rule specifies that first adaptation parameter set network abstraction layer units are disallowed from being simultaneously stored in in the visual media file in (1) any one or both of samples of video coding layer tracks or sample entries of the video coding layer tracks, and (2) samples of non-video coding layer tracks, where the video coding layer tracks are tracks containing video coding layer network abstraction layer units, and where the first adaptation parameter set network abstraction layer units includes luma mapping with chroma scaling parameters for a video stream and scaling list parameters for the video stream.