In one embodiment according to the invention, there is disclosed a method of identifying a source of a vacuum quality problem in a vacuum environment associated with a tool. The method comprises gathering and storing vacuum environment data; identifying an anomaly within the vacuum environment; determining a tool component operating state when the anomaly likely occurred; and determining the source of the vacuum quality problem based on a state of the vacuum environment when the anomaly likely occurred and the tool component operating state when the anomaly likely occurred.