A gaze position detection apparatus. A dictionary section previously stores a plurality of dictionary patterns representing a user's image including pupils. An image input section inputs an image including the user's pupils. A feature point extraction section extracts at least one feature point from a face area on the input image. A pattern extraction section geometrically transforms the input image according to a relative position of the feature point on the input image, and extracts a pattern including the user s pupils from the transformed image. A gaze position determination section compares the extracted pattern with the plurality of dictionary patterns, and determines the user's gaze position according to the dictionary pattern matched with the extracted pattern.