An imaging and display system for guiding medical interventions includes a wearable display, such as a goggle display, for viewing by a user. The display presents a composite, or combined image that includes pre-operative surgical navigation images, intraoperative images, and in-vivo microscopy images or sensing data. The pre-operative images are acquired from scanners, such as MRI and CT scanners, while the intra-operative images are acquired in real-time from a camera system carried by the goggle display for imaging the patient being treated so as to acquire intraoperative images, such as fluorescence images. A probe, such as a microscopy probe or a sensing probe, is used to acquire in-vivo imaging/sensing data from the patient. Additionally, the intra-operative and in-vivo images are acquired using tracking and registration techniques to align them with the pre-operative image and the patient to form a composite image for display by the goggle display.