A video recording apparatus is configured to record, onto a recording medium, a layered data structure containing data sets. Each of the data sets includes a plurality of channels of data elements. Each of the data elements includes video data and/or the like. An input unit is configured to receive a plurality of channels of video data. The plurality of channels correspond to each other. An information generation unit is configured to generate additional information to be added to each of the data elements in at least two layers of the data structure. An adding unit is configured to add the additional information to each of the data elements so that the data elements included in each of the data sets are associated with each other. A recording unit is configured to record the data structure in which the additional information has been added to each of the data elements onto the recording medium.