A pilot training evaluation system and method includes receiving a first training performance data set. The pilot training evaluation system and method also includes analyzing the first training performance data set to determine a correlation between the first training performance data set and a training data comparison set, generating a training modification recommendation for an automated training system based at least on the correlation, and communicating the training modification recommendation to the automated training system.