In an image within which a face pattern is detected, when a ratio of a skin color pixel is equal to or smaller than a first threshold value in a first region and a ratio of a skin color pixel is equal to or greater than a second threshold value in a second r region, the vicinity of the first region is determined to be a face candidate position at which the face pattern can exist. Face detection is carried out on the face candidate position. The second region is arranged in a predetermined position relative to the first region.