In an elementary stream, when decoding an audio stream not containing a synchronization word or CRC, generation of an allophone is prevented. When decoding a current frame, the private header of the next frame is analyzed. If the private header of the next frame is invalid, the current frame is muted. Moreover, at a discontinuous point generated by edition, decoding is resumed at the start address of the next frame notified by the stream analysis means.