The described technology is generally directed towards reducing unwanted cellular network activities, such as phantom 911 calls or other unwanted cellular network activities. Machine learning models described herein can be trained, using device level data and network level data, to identify devices that are likely to engage in an unwanted cellular network activity. A trained machine learning model can be deployed to identify devices, and devices identified by the trained machine learning model can be re-configured to prevent them from engaging in the unwanted cellular network activity. Devices likely to engage in the unwanted cellular network activity are thus identified and reconfigured to prevent future unwanted cellular network activity before it occurs.