An image input unit inputs an image including a user's face area to specify the user's gaze or face direction. A pattern generation unit generates an input pattern that can be compared with each dictionary pattern from the image. A dictionary unit previously stores a plurality of dictionary patterns each of which differently corresponds to the user's gaze or face direction. A pattern comparison unit respectively calculates a similarity degree between the input pattern and each of the dictionary patterns by comparing the input pattern with each of the dictionary patterns. A gaze detection unit detects the user's gaze or face direction based on the similarity degree.