A binaural hearing system (“system”) preserves and/or enhances interaural level differences (“ILDs”) between first and second signals. The system includes audio detectors each associated with an ear of a user. The audio detectors detect an audio signal presented to the user and generate the first and second signals to represent the audio signal as detected at each ear. The system also includes sound processors associated with each ear that each receive the first and second signals from the audio detectors directly and/or by way of a communication link from the other sound processor. The sound processors each perform operations with respect to the first and second signals to preserve and/or enhance the ILDs between the signals. In so doing, the sound processors perform a contralateral gain synchronization operation to a first degree at the first sound processor and to a distinct second degree at the second sound processor.