A system and method of categorizing communications involves evaluating one or more portions of a communication. Systems include a language module structured to analyze the one or more portions of the communication for at least one of a language characteristic or a non-word symbol within a text of the communication, an acoustic analysis module structured to analyze the one or more portions of the communication for an acoustic characteristic, and a determination module structured to determine at least one category label to associate with the one or more portions of the communication using at least one of the language characteristic or the non-word symbol, and the acoustic characteristic.