The present invention involves a vectorized multi-material fiducial reference for use in tracking on a user-calibration free basis a non-visible scan-detectable structure of a body as part of a three-dimensional tracking system. The fiducial consists of scan-detectable elements embedded within the body of the fiducial, the body being formed of a material compatible with the tracked body. The scan-detectable elements are embedded in a rotationally asymmetric pattern in the fiducial with to an accuracy compatible with surgery. A vectorized tracking marker may be attached directly or indirectly to the fiducial. The system employs a controller in communication with a non-stereo optical tracker to track in real time the marker and thereby the fiducial based on a prior scan of the surgical site with the fiducial attached. A method for manufacturing the fiducial employs pins to hold the scan-detectable elements accurately in position while forming the body of the fiducial around the elements.