The invention relates to a visual axis detection apparatus and the like which is constituted by light receiving device for receiving image of an observer's eye, read-out device for reading out the photoelectric conversion signals from the light receiving device, information processing device for extracting a plurality of characteristic information on the basis of the signals read out by the read-out device and outputting information regarding the direction of the observer's visual axis and restricting device for giving a restriction to the read-out area of the light receiving device.