An information processing apparatus includes: an inputting section adapted to input an image; a detection section adapted to detect a portion of an image pickup object from within the inputted image; a noticed region setting block adapted to set a noticed region from the detected portion; a restriction region setting block adapted to set a restriction region from the detected portion; and an extraction section adapted to extract feature values of the noticed region restricted by the restriction region.