A method and apparatus are provided for encoding with hypothetical reference decoder compliant bit allocation. The apparatus includes an encoder (100) for encoding image data for a picture in a resultant bitstream by controlling a bit allocation during the encoding of the image data responsive to satisfying requirements for a subsequent decoding of the bitstream. The requirements relate to preventing at least one of an underflow condition and an overflow condition in a buffer during the subsequent decoding of the bitstream.