A manipulator system includes a medical instrument which is capable of being inserted into a body; a manipulator which is capable of holding the instrument; a holding detector which detects a holding state where the manipulator holds the instrument; an instruction-receiving part which detects an instruction for operating the instrument; and a controller which operates the instrument only in a case where the instruction-receiving part detects the instruction when the holding detector detects the holding state.