An image recognition device includes an input section for inputting an image; a pattern extraction section for extracting a plurality of predetermined patterns from the input image; a first feature extraction section for extracting a first feature indicating the direction in which the first pattern of the extracted predetermined patterns exists with respect to a point on a second pattern of the extracted predetermined patterns; a second feature extraction section for extracting a second feature indicating an amount of the first pattern existing in the direction with respect to the second pattern, based on the first feature; and a recognition section for recognizing the input image based on the second feature.