A system for using radio frequency (RF) communication signals to extract situational awareness information thorough deep learning. Pre-processing is performed to maximally preserve discriminating features in spatial, temporal and frequency domains. A specially designed neural network architecture is used for handling complex RF signals and extracting spatial, temporal and frequency domain information. Data collection and training is used so that the learning system desensitizes from features orthogonal to the underlying classification problem.