A system or computer usable program product for controlling a hearing aid based on an adjustable policy including receiving an input signal; receiving an indication signal from a user identifying the input signal; receiving an adjustment to the hearing aid with the indication signal; and utilizing a processor to store the input signal in memory with the adjustment to the hearing aid as an adjustable policy corresponding to the input signal.