A method for performing parallel coding with ordered entropy slices includes: providing a plurality of entropy slices to a plurality of processing elements, wherein each entropy slice includes a plurality of blocks; initializing CABAC states of a current entropy slice as the CABAC states of a previous entropy slice after processing DB blocks of the previous entropy slice. DB is a positive integer.