A surface inspection system, as well as related components and methods, are provided. The surface inspection system includes a beam source subsystem, a beam scanning subsystem, a workpiece movement subsystem, an optical collection and detection subsystem, and a processing subsystem. The system features a variable polarization a polarizing relay assembly arranged to selectively permit the scattered light having a selected polarization orientation to pass along a detector optical axis to a light detection unit in the detection subsystem. The system also features a collector output width varying subsystem for varying the width of an output slit in response to changes in the location of the location scanned on the workpiece.