The present invention provides means and corresponding embodiments to control charge-up in an electron beam apparatus, which can eliminate the positive charges soon after being generated on the sample surface within a frame cycle of imaging scanning. The means are to let some or all of secondary electrons emitted from the sample surface return back to neutralize positive charges built up thereon so as to reach a charge balance within a limited time period. The embodiments use control electrodes to generate retarding fields to reflect some of secondary electrons with low kinetic energies back to the sample surface.