An endoscope system includes at least an endoscope of the endoscope and an accessory, a placement unit on which the endoscope is adapted to be placed, a detecting unit configured to detect whether the endoscope is placed on the placement unit or not, an actuating unit for at least one of the endoscope and the accessory, an operating unit for operating the actuating unit, and a control unit configured to be switched between a normal mode wherein the actuating unit is controlled according to an operation to the operating unit and a restricting mode wherein the actuating unit is controlled regardless of an operation to the operating unit, on the basis of a result of detection by the detecting unit.