A method and system for encoding video data in a constant bit rate video encoder. A video encoder may determine a coding mode for encoding a block of video data from among one or more coding modes based on a minimum syntax element size and a maximum syntax element size, wherein the minimum syntax element size is greater than 1 bit, encode the block of video data in a plurality of substreams according to the determined coding mode to create a plurality of encoded substreams of video data, store the plurality of encoded substreams of video data in respective balance FIFO buffers, and multiplex the plurality of encoded substreams in a bitstream for transmitting to a decoder.