A method for multi-modal tissue classification of an anatomical tissue involves a generation of a tissue classification volume (40) of the anatomical tissue derived from a spatial registration and an image extraction of one or more MRI features of the anatomical tissue and one or more ultrasound image features of the anatomical tissue. The method further involves a classification of each voxel of the tissue classification volume (40) as one of a plurality of tissue types including a healthy tissue voxel and an unhealthy tissue voxel.