A system and method are provided for time scaling playback of digital audio signals with associated digital video signals. Initially, the digital video signals and the digital audio signals are received. Next, the digital audio signals are processed for the time scaling thereof while substantially preserving the frequency pitch of the digital audio signals. The processed audio signals are then encoded. Such encoded audio signals are then outputted for accelerated playback with the associated digital video signals.