A charged particle beam device using a multi-pole type aberration corrector includes: a charged particle source which generates a primary charged particle beam; an aberration correction optical system which corrects aberrations of the primary charged particle beam; a detection unit which detects a secondary charged particle generated from a sample irradiated with the primary charged particle beam whose aberrations have been corrected; an image forming unit which forms a charged particle image of the sample from a signal obtained by detecting the secondary charged particle; an aberration correction amount calculation unit which processes the charged particle image, separates aberrations having different symmetries, selects an aberration to be preferentially corrected from the separated aberrations, and calculates a correction amount of the aberration correction optical system; and an aberration correction optical system control unit which controls the aberration correction optical system based on the calculated correction amount.