In one example, a device for coding (e.g., encoding or decoding) video data includes a memory configured to store video data, and a video coder configured to code hypothetical reference decoder (HRD) parameters for each sub-layer of each bitstream partition of a video bitstream; and process the video bitstream using the HRD parameters. The video coder may code the HRD parameters in the form of a loop over the HRD parameters that is iterated for each of the sub-layers, and/or indexes to respective sets of HRD parameters for each of the sub-layers.