The invention relates to a system (SYS) for automatically extracting a location of an abnormality with respect to an anatomical structure from a report, the system comprising a tokenizer (U10) for tokenizing the report or a part of it, thereby producing a plurality of tokens, and an analyzer (U20) for identifying a semantic structure comprising identified tokens of the plurality of tokens, describing the location of the abnormality with respect to the anatomical structure. Optionally, the system further comprises a mapper (U30) for annotating a diagram representing the anatomical structure, based on the identified semantic structure describing the location of the abnormality with respect to the anatomical structure. Using the system, the location of the abnormality with respect to the anatomical structure can be extracted from each report of the plurality of reports produced over the period of time. The extracted locations may be used by a clinician for diagnostic purposes.