An audio processing system includes a voice decoder and an audio processor. In one exemplary embodiment, the audio processing system is embedded in a headset unit that is wirelessly coupled to a game console. The voice decoder is used to decode a stream of incoming voice data packets carried over a wireless signal. The decoded voice data packets are used to drive an audio transducer of the headset unit. Upon detection of an error in the incoming stream, a decoded error-free voice data packet that has been stored in a replay buffer is used to generate an amplitude scaled audio signal. The voice decoder is disconnected from the audio transducer and the scaled audio signal is used to drive the audio transducer instead.