A hearing system includes a hearing aid (10) and a personal communication device (20) being connected via a short range data communication link. The hearing aid (10) has a signal processor (13) processing an input signal according to audio processing parameters, a sub-system applying respective sets of processing parameters for at least two modes, a classifier component (51) analyzing auditory environment statistically by comparing specific characteristics of the input signal to one or more thresholds. A program selector component (16) selects automatically an appropriate mode for the signal processing sub-system according to the classifier output. The personal communication device (20) offers the user a user interface for controlling and interacting with the program selector component (16) of the hearing aid (10), and for generating and transmitting a notification to the hearing aid (10). Upon reception of the notification, the processor (13) adjusts at least one of said one or more thresholds used by the classifier component (51).