A system and method for annotation of patient image data. First, an image block having image data such as an image series is acquired. Then at least one geometric shape having associated annotation data is defined within the image block and at least one display plane is selected within the image block. The image data associated with the display plane is displayed. Finally, it is determined if the display plane intersect with the geometric shapes and for each display plane that intersects with a geometric shape, the annotation data associated with the geometric shapes being intersected by that display plane is displayed.