An accent detection system for automatically labeling accent in a large speech corpus includes a first classifier which analyzes words in the speech corpus and automatically labels accents to provide first accent labels. A second classifier analyzes the words to automatically label accent of the words to provide second accent labels. A comparison engine compares the first and second accent labels. Accent labels that indicate agreement between the first and second classifiers are provided as final accent labels. When there is disagreement between the first and second classifiers, a third classifier analyzes the words and provides the final accent labels.