A medical system includes: a first operation apparatus used when a first doctor operates a medical instrument; a second operation apparatus that outputs a control instruction signal for controlling a motion of the medical instrument, and is operated by a second doctor; at least one medical action information detection section that detects medical action information based on the motion of the medical instrument when the first doctor operates the medical instrument using the first operation apparatus; a storage apparatus that stores reference information set by the second doctor according to the first doctor for comparing with the medical action information detected by the medical action information detection section; a switching signal generation apparatus that is connected to the second operation apparatus, and switches an output destination of the control instruction signal based on the medical action information detected by the medical action information detection section and the reference information stored in the storage apparatus; and a medical instrument control apparatus that controls the medical instrument according to the control instruction signal of the second operation apparatus outputted from the switching signal generation apparatus.