A remote control system includes a mobile device and a receiver connected to a control target. The mobile device includes an input unit accepting user's input operation; an operation signal transmission unit wirelessly transmitting an operation signal corresponding to the input operation during the input operation; a frequency switching determination unit determining whether to switch the transmission frequency band from a first frequency band to a second frequency band based on at least any one of a manner of the input operation and a state of wireless communication; and a transmission frequency switching unit switching the transmission frequency band when the frequency switching determination unit determines to switch the transmission frequency band. The receiver includes an operation signal reception unit receiving the operation signal; and a control unit controlling the control target on the basis of the received operation signal.