Example aspects of the present disclosure are directed to systems and methods for performing automatic label smoothing of augmented training data. In particular, some example implementations of the present disclosure which in some instances can be referred to “AutoLabel” can automatically learn the labels for augmented data based on the distance between the clean distribution and augmented distribution. AutoLabel is built on label smoothing and is guided by the calibration-performance over a hold-out validation set. AutoLabel is a generic framework that can be easily applied to existing data augmentation methods, including AugMix, mixup, and adversarial training, among others. AutoLabel can further improve clean accuracy, as well as the accuracy and calibration over corrupted datasets. Additionally, AutoLabel can help adversarial training by bridging the gap between clean accuracy and adversarial robustness.