A method and apparatus of context-based adaptive binary arithmetic encoding/decoding for syntax elements of one or more blocks are disclosed. According to one embodiment of the present invention, the binarization results of the x and y positions of the last significant coefficient of a transform unit are reordered by collecting the bypass bins together. According to another embodiment of the present invention, binarization results of syntax elements from two or more of four Intra N×N prediction units, including prev_intra_luma_pred_flag, rem_intra_luma_pred_mode, and mpm_idx are reordered by collecting the bypass bins together. In yet another embodiment according to the present invention, the binarization results of other syntax elements are also reordered by collecting bypass bins together. Furthermore, the above reordering of binarization results may be used for binarization results corresponding to a block and its neighboring blocks.