A method and system of determining quality of a document image is disclosed that includes segmenting, by one or more processors, a document image into a plurality of regions each of which comprises text data. The plurality of regions is classified into one of a plurality of image quality classes based on a determination of a highest prediction value from one of a plurality of machine learning models. The plurality of machine learning models is trained corresponding to one of the plurality of image quality classes. A cumulative quality score for the image is computed based on a weighted average of a number of regions classified into each of the plurality of image quality classes. The quality of the image is determined based on the cumulative quality score.