A vehicle system includes communication circuitry programmed to communicate with a controller that is removable from an autonomous vehicle. The system further includes a processor programmed to receive control signals, which are associated with manually controlling the autonomous vehicle in a non-autonomous mode, transmitted from the controller. The processor is further programmed to output commands to at least one vehicle subsystem in accordance with the control signals transmitted from the controller while the vehicle is operating in a non-autonomous mode.