A method for managing media streams including at least video data and audio data in a multi-party video conference involving one or more groups of one or more nodes respectively receiving a media stream from each of a plurality of associated endpoints is provided. In each of the one or more nodes of each of the one or more groups, the loudest audio of the media streams received from the respective plurality of associated endpoints is determined. An indication of the volume of the determined loudest audio and an identification of the node is transmitted to a decision maker. The highest received volume and the associated identification is determined. The node of the identification is instructed to transmit the received media stream of the endpoint to one of: all nodes in the one or more groups and to a proxy.