A system for adaptive electron beam scanning may include an inspection sub-system configured to scan an electron beam across the surface of a sample. The inspection sub-system may include an electron beam source, a sample stage, a set of electron-optic elements, a detector assembly and a controller communicatively coupled to one or more portions of the inspection sub-system. The controller may assess one or more characteristics of one or more portions of an area of the sample for inspection and, responsive to the assessed one or more characteristics, adjust one or more scan parameters of the inspection sub-system.