A method for comparing a ranking scheme for an object, such as a document image, with a known standard, or ideal ranking scheme for a comparative assessment of the performance and reliability of the two ranking schemes, is taught. The same set of objects are processed and ranked by both ranking schemes. The ranking scheme being tested is examined for all subject objects ranked lower than its ranking by the ideal ranking scheme. The test ranking scheme is charged for each swapped object which it ranked higher than the subject object, which the ideal ranking scheme ranked lower.