A system and method for scaling an MPEG-2 video decoder subject to a resource constraint. A decoder system is provided for decoding compressed video data arranged in a group of pictures, wherein the group of pictures include I pictures, P pictures and B pictures. The system comprises a processing path for decoding an error residual associated with the group of pictures, and a filtering system for preventing the error residual associated with B pictures from being decoded by the processing path. The decoder system may further comprise a system for selectively enabling the filtering system for B pictures having a DC coefficient that is below a predetermined threshold.