Automated response processing includes receiving a first audible prompt from a called system and a response to the first audible prompt from a calling system during a first phone call. Automated response processing further includes determining, using a processor, a semantic identifier for the first audible prompt using semantic analysis and storing the semantic identifier of the first audible prompt in association with the response. The stored response is played responsive to determining that a semantic identifier for a second audible prompt played to the calling system matches the semantic identifier of the first audible prompt.