A method for associating text with image data of documents is herein described. The method includes receiving image data of a document with manually marked text and recognizing the manually marked text. The image data is then annotated (e.g., tagged) using the manually marked text and the image data of the document is stored. When manually marked text is recognized, recognized text may be generated for annotating the image data of the document and used to populate a field associated with the image data. The field may be a name of the document or a subject line of an e-mail message, for example. A method including identifying the location of manually marked text in a first scanned document to automatically identify and annotate text in a corresponding location in a second scanned document is also disclosed.