Embodiments of the disclosure relate to selective voice transmission and include receiving an identification of one or more authorized speakers for a telephone call and retrieving a voice sample for each of the one or more authorized speakers. Embodiments also include receiving one or more audio signals for the telephone call and filtering the one or more audio signals by removing a portion of the one or more audio signals that do not contain a voice of at least one of the one or more authorized speakers in the one or more audio signals.