Disclosed is a method of decoding a plurality of coding units from a bitstream of video data. The method determines a coding unit structure of the plurality of coding units from a first data block of the bitstream. The coding unit structure describes a division of a coding unit into the plurality of coding units. The method decodes, according to the determined coding unit structure, bypass encoded data for the plurality of coding units from a second data block of the bitstream. The method decodes, according to the determined coding unit structure, residual data for the plurality of coding units from a third data block of the bitstream. The method then forms the plurality of coding units from the bitstream using the residual data and the bypass encoded data. A method of encoding is also disclosed.