To reduce degradation of image quality occurring upon correction of an image shake, provided is an image pickup apparatus including: an image pickup optical system; an image pickup element for photoelectrically converting an image formed by the image pickup optical system; a processing unit for processing a taken image; a detection unit for detecting a shake of the image pickup apparatus; and an image stabilizing unit for decentering an image stabilizing lens unit formed as a part of the image pickup optical system based on a detection result from the detection unit. The processing unit performs the process by using an image restore filter corresponding to a position of the image stabilizing lens unit at a time of image taking.