Systems and methods are disclosed in which an external device such as a consumer mobile device (e.g., smart phone) is used as an external controller to bi-directionally communicate with an Implantable Medical Device (IMD) using a dedicated patient remote control (RC) as an intermediary device to translate communications between the two. The dedicated RC contains a graphical user interface allowing for control and monitoring of the IMD even if the mobile device is not present in the system, which is useful as a back-up should the mobile device experience problems. Use of the dedicated RC as an intermediary device broadens the utility of other computing devices to operate as an external controller for an IMD even if the computing device and IMD do not have compliant communication means.