Techniques, systems, and devices relating to conducting calibration of LIDAR systems are disclosed. In one exemplary aspect, a light detection and ranging (LIDAR) device is disclosed. The device comprises a light beam emitter operable to emit a light beam; a prism set positioned in an optical path of the light beam to refract the light beam onto a surface of a surrounding object; a light detector to detect light reflected by the surface of the surrounding object; a controller configured to estimate the surface of the surrounding object based on the detected light. The controller is operable to (1) determine a relative bias in the prism set, and (2) cause, based on the relative bias in the prism set, a compensation for an estimation error in the controller's estimation of the surface of the surrounding object.