A system for defect detection and analysis is provided. The system may include an inspection sub-system and a controller including a memory and one or more processors. The inspection sub-system may include an illumination source and one or more detectors configured to acquire control patch images of defects of a control specimen along one or more detector channels. The one or more processors may be configured to train a defect classifier using the control patch images and known parameters associated with the defects of the control specimen. The inspection sub-system may be further configured to acquire patch images of identified defects on an additional specimen. The one or more processors may be configured to determine parameters of the identified defects using the defect classifier.