A method includes generating a real-time ultrasound image of anatomy of interest. At least a sub-portion of the anatomy of interest is deformed from an initial location to a different location by pressure applied by an external force. The method further includes obtaining a 2-D slice, which corresponds to a same plane as the real-time ultrasound image, from 3-D reference image data, wherein a corresponding sub-portion is at the initial location. The method further includes determining displacement fields for the sub-portion from the sub-portion, the corresponding sub-portion and other anatomy not-deformed in the real-time ultrasound image and the 3-D reference image data. The method further includes deforming the 3-D reference image data using the displacement fields, which creates deformed 3-D reference image data based on the different location.