A method and system of prioritizing calls based on audio stream analysis includes receiving a plurality of calls, wherein each call comprises an audio stream. The audio stream associated with one of the calls is analyzed for pre-determined audio characteristics. The call is processed based on the audio characteristics of the call. A system for prioritizing calls includes a multipoint control unit for receiving calls. An audio stream capture system captures an audio stream from the calls. The audio stream is analyzed by the capture system according to one or more selected criteria and an urgency priority ranking is determined for each call. The calls are ranked in a queue database according to urgency priority. A controller manages the audio stream capture system, the audio analyzer and queue database computer system.