An endoscope system includes a determining section that determines whether or not an image pickup device is moving at a predetermined speed or higher based on position/direction information and determines, when the image pickup device is not moving at the predetermined speed or higher, that a subject internal image is an image that can be pasted onto a model image of a predetermined organ in a state where the position/direction information of an objective optical window and position/direction information in a coordinate system of the predetermined organ model image are associated with each other, and an image pasting section that reads the subject internal image determined to be the image that can be pasted from the memory and pastes the subject internal image onto the model image of the predetermined organ based on the position/direction information.