An audio customization system responsive to one or more inputs that enhance aspects of an audio output and one or more inputs that diminish aspects of an audio output. The system is set up to be able to lessen the influence of ambient audio or in some situations enhance ambient audio over source audio. The system may specify aspects of audio to be modified by specification of filtering algorithm, characterization of audio samples, monitored distortion, user selection, location specification or environmental specification.