The disclosure relates to a hearing system comprising a first hearing device including a first sensor configured to provide first sensor data; a second hearing device including a second sensor configured to provide second sensor data indicative of a displacement of the second hearing device and/or a property detected on the user at the location of the second hearing device; and a processing unit communicatively coupled to the first and second sensor. The disclosure further relates to a method of operating the hearing system and a computer-implemented method.