A visual facet search engine utilizes a machine learned model for identifying an image for a facet option. Specifically, the engine receives a search image as a search query at a search engine. Further, the engine identifies search results for the search query based on search image features extracted from the search image. The search results comprise item listings associated with item listing images. In addition, the engine determines facets and facet options for the search image based on the search results. Further, the engine employs the machine learned model to identify an item listing image among the item listing images. Furthermore, the engine provides the item listing image for display as selectable facet option for navigating the search results.