The image pickup apparatus includes an image sensor photoelectrically converting paired object images formed by light fluxes from mutually different pupil areas of an image capturing optical system, a signal producing part producing, by using output from each of plural pixel lines in a focus detection area in the image sensor, paired image signals corresponding to the paired object images for each pixel line, a calculating part calculating a defocus amount by using the paired image signals produced for each pixel line. The calculating part shifts the paired image signals relatively, produce first correlation data showing change of a correlation value of the paired image signals according to their relative shift amount, adds the first correlation data produced for the respective plural pixel lines to produce second correlation data, and calculates the defocus amount from the second correlation data.