A method includes receiving, at a computing system, audio data from one or more microphones associated with a vehicle. In one example, the audio data originates from a source external to the vehicle and the vehicle is configured to operate in an autonomous mode. The method also includes processing the audio data to generate directional data related to a direction of the source of the audio data relative to the vehicle and processing the audio data to generate identification data related to an identity of the source of the audio data. Further, the method includes controlling the vehicle in the autonomous mode in response to the directional data and the identification data, using the computing system.