An endoscope system includes: an endoscope for picking up an image in a body cavity by an image pickup apparatus provided in a distal end of an insertion portion; a position detecting apparatus for detecting, based on luminal information acquired by the image pickup apparatus, position information used for inserting the distal end of the insertion portion; a recording apparatus for recording, in a time-sequential manner, the position information detected by the position detecting apparatus; a determining apparatus for determining whether or not the detecting operation of the position information performed by the position detecting apparatus satisfies a set condition; and a direction calculating apparatus for, when the determination result shows that the set condition is not satisfied, reading out the position information recorded in the recording apparatus and outputting information on a direction in which the distal end of the insertion portion is to be inserted.