Systems and processes for identifying relevant domains for user inputs that include one or more ambiguous words are disclosed. The ambiguous words include words that may or may not refer to a named entity, such as a song, movie, book, etc. In one example, a textual representation of user speech can be received and processed to identify a candidate named entity. The possible parts of speech of the candidate named entity can be determined and compared to a predetermined set of parts of speech. In response to determining that the possible parts of speech of the candidate named entity do not include one or more of the predetermined set of parts of speech, a saliency score associated with the candidate named entity can be lowered. A domain for processing the textual representation of user speech can then be identified using the saliency score associated with the candidate named entity.