The present invention can reliably adjust the lip-sync between an video and audio at a decoder side, without making the viewer feel strangeness.In this invention, the encoded video frames to which video time-stamps VTS are attached and the encoded audio frames to which audio time-stamps ATS are attached, all received, are decoded, generating a plurality of video frames VF1 and a plurality of audio frames AF1. The video frames VF1 and audio frames AF1 are accumulated. Renderers 37 and 77 calculate the time difference resulting from a gap between the reference clock for the encoder side and the system time clock stc for the decoder side. In accordance with the time difference, the timing of outputting the plurality of video frames, one by one, on the basis of a timing of outputting the plurality of audio frames, one by one. Hence, the lip-sync can be achieved, while maintaining the continuity of the audio.