A system and method for identifying special information within a voice recording is provided. Training to identify a speaker is performed. A voice recording including utterances by at least two speakers is processed to identify segments of the voice recording provided by the speaker. Remaining segments of the voice recording are designated as provided by another speaker. A text element that corresponds to a request for information is identified in at least one of the segments of the voice recording provided by the speaker. A predetermined duration associated with the identified text element is applied to one of the segments of the voice recording of the other speaker occurring immediately after the segment of the voice recording from the regular speaker with the identified text element. The utterances from the other speaker occurring within the predetermined duration are identified as special information and rendered unintelligible.