A system and method for applying Rate Distortion Optimized Quantization (RDOQ) is disclosed. In one example, there is provided a method that includes determining at least one prediction type and at least one partition type for use in encoding at least one block of video data. The method further includes applying a non-RDOQ quantization scheme to the at least one block of the video data. The non-RDOQ quantization scheme may be applied during the determination of the at least one prediction type and the at least one partition type. The method further includes applying an RDOQ quantization scheme to the at least one block upon determining the at least one prediction type and the at least one partition type.