An image processing apparatus including a CPU which is operable to function as units comprising a processing unit which sets, as a first area, an area that is not a peripheral edge area in a captured image acquired by an imaging unit, sets an area including the peripheral edge area as a second area, and performs predetermined processing on one of the first area and the second area, and a specification unit which specifies whether the first area is subjected to the predetermined processing or the second area is subjected to the predetermined processing, based on orientation information of the imaging unit when the captured image is acquired.