This remote control robot system is provided with: a robot main body (1) having a robot arm (10); a remote control device (2) having a robot arm operation command input unit (70) which an operator operates by touch to input operation commands for the robot arm, and a contactless action detection unit (71) which detects contactless actions, which include one or more prescribed operation command actions of an operator; and a control device (3) which is connected to the remote control device so as to communicate therewith and which controls operation of the robot main body. The control device isprovided with a storage unit (32) which stores operation command content data, which defines operating modes of the robot main body that correspond to each of one or more operation command actions, anoperation command content specifying unit (34) which specifies an operating mode of the robot main body that corresponds to the operation command action detected by the contactless action detection unit on the basis of the operation command content data, and an operation control unit (33) which controls operation of the robot main body on the basis of the operating mode specified by the operationcommand content specifying unit.