Disclosed is a face component extraction apparatus including an eye detection unit which detects a plurality of combinations of eye regions, each combination forming a pair, a first calculation unit which calculates a first evaluation value for each pair of eye regions, a fitting unit which fits a plurality of extraction models for extracting a plurality of face components in the image based on a number of pairs of eye regions whose first evaluation values are equal to or greater than a predetermined value, a second calculation unit which calculates a second evaluation value for each of a number of pairs of eye regions, and a deciding unit which decides a fitting mode of the plurality of extraction models to be fitted by the fitting unit based on calculation results of a number of second evaluation values by the second calculation unit.