A portable patient communicator (PPC) includes a portable housing supporting a processor, memory for storing medical and wireless radio firmware, first and second radios, a processor, an identity module, and a power source. The PPC and a patient implantable medical device (PIMD) communicate via the first radio in accordance with the medical firmware. The PPC communicates with a wireless network via the second radio in accordance with the wireless radio firmware. Data stored in the identity module is used to authenticate the PPC by the remote server prior to permitting PPC access to the remote server, and may also be used to authenticate the remote server by the PPC prior to permitting access to the PPC or the PIMD by the remote server or other device communicatively coupled to the wireless network, after which PIMD and other medical data is exchanged between the PPC and remote server.