In one embodiment, a multi-microphone system for an endpoint device receives input signals for a remote conference between the endpoint device and at least one other endpoint device. The multi-microphone system may include at least a top microphone unit and a bottom microphone unit. A signal degradation event that causes degradation of signals received by the top microphone unit or the bottom microphone unit is detected. Then, based on information regarding the signal degradation event, it is determined whether the signal degradation event affects one or both of the top microphone unit and the bottom microphone unit. In response, an output signal is generated for transmission to the at least one other endpoint device, and the output signal uses a portion of the input signals that excludes signals received by the top microphone unit and/or the bottom microphone unit determined to be affected by the signal degradation event.