A hearing device, e.g. a hearing aid or a headset, configured to be worn at or in an ear of a user, the hearing device comprising at least one input transducer for converting a sound in an environment of the hearing device to at least one electric input signal representing said sound; an own voice detector configured to estimate whether or not, or with what probability, said sound originates from the voice of the user, and to provide an own voice control signal indicative thereof, a face mask detector configured to estimate whether or not, or with what probability, said user wears a face mask while speaking, and to provide face mask control signal indicative thereof. A method of operating a hearing device is further disclosed. Thereby an improved hearing aid or headset may be provided.