In an imaging apparatus having a solid-state imaging device in which a focus detection pixel (phase difference detection pixel) is mounted on a light receiving surface, when dust is attached on the light receiving surface, a phase difference amount in a dust presence region is calculated from a detection signal of a phase difference detection signal and reliability of the phase difference amount is determined and when the reliability is high, phase difference AF control is performed with the phase difference amount calculated in the dust presence region.