Audio processing is provided to determine whether an audio issue is present within a multi-participant communication system such as a teleconference or videoconference bridge or a trunk dispatch system. Audio issues such as background noise, background conversations, or other unwanted audio that is being interjected into the multi-participant conversation and that may be dominating the audio are detected by measuring characteristics of audio samples taken from the communication ports of the multi-participant communication system. A correction may then be applied to the audio received through the communication port by a processor of the multi-participant communication system without intervention by an administrator, such as by muting the port, applying a noise cancellation to audio from the port, or time-shifting the audio from the port.