A hearing system is adapted to be worn by a user and configured to capture sound in an environment of the user and comprises a) a sensor array comprising M transducers for providing M electric input signals representing said sound and having a known geometrical configuration relative to each other; b) a detector unit for detecting movements over time of the hearing system, and providing location data of said sensor array at different points in time t, t=1, . . . , N; c) a first processor for receiving said electric input signals and—in case said sound comprises sound from a localized sound source S—for extracting sensor array configuration specific data τij of said sensor array indicative of differences between a time of arrival of sound from said localized sound source S at said respective input transducers, at said different points in time t, t=1, . . . , N; and d) a second processor configured to estimate data indicative of a location of said localized sound source S relative to the user based on corresponding values of said location data and said sensor array configuration data at said different points in time t, t=1, . . . , N.