In a portable apparatus of a medical system, in a case where an operation unit receives an operation from a physician on the basis of the display contents of a display unit, the medical apparatus controlled as a result of the operation of the operation unit by an operator is defined by an operation control unit, and a signal in response to the operation contents received by the operation unit is transmitted from a transmission unit to the defined medical apparatus.