A surgical robot control system including a controller, a coupling system, a sensor, and a feedback device is disclosed. The coupling system is configured to couple a handheld surgical user interface to the controller. The handheld user interface may control a function of a robotic surgical system. The sensor is coupled to the controller and the coupling system and is configured to detect actuation of the handheld user interface and to communicate detected actuations to the controller. The feedback device is coupled to the controller and is configured to provide feedback associated with the robotic surgical system to a user. The controller is communicatively coupleable to the robotic surgical system and is configured to send robot control signals to the robotic surgical system, to receive feedback signals from the robotic surgical system, and to send feedback control signals to the feedback device to control the feedback provided to the user.