A focus adjustment device for carrying out focus adjustment by moving a focus lens, comprises a point light source determination section which determines a point-like light source subject based on the image signals, an orientation stability determination section which determines stability of orientation by detecting orientation of the focus adjustment device, a photometry section which outputs photometric values corresponding to subject brightness based on the image signals, and a focus adjustment section which carries out a focus adjustment operation using the image signals, based on a determination result of the point light source determination section, wherein the point light source determination section, in a state where a point-like light source subject is currently determined, when a determination result of the orientation stability determination section indicates unstable and a photometric value output from the photometry section does not indicate low brightness, determines that the subject is not a point-like light source.