Devices, software and methods are provided for generating aggregate comfort noise for teleconferencing over IP networks. A transcoding component includes a decoder for decoding streams of packets. A summing component has a summer with summing inputs to receive the decoded streams of packets. The summing component has at least one silence flag input, and an additional signaling path is used by the transcoding component to signal to the silence flag input if any of the decoded streams of packets includes a silence identification packet. In another embodiment, the summing component may or may not include the silence flag input, but the device includes an aggregate comfort noise generation component. The aggregate comfort noise may be programmed to be a balanced representation of all background noises.