Embodiments of the invention provide a system for automated document conversion testing. For each page in the received documents, the system first converts the page into a source image. The system then converts the document page into a set of markup language page elements and generates a rendered image of the markup language page elements displayed in a web browser on a target software platform. Next, the system determines a correlation factor between the source image and the rendered image. The correlation factor indicates a page fidelity between the original document and its markup language transformation. If the correlation factor exceeds a threshold established for a minimum page fidelity requirement, the markup language conversion is validated.