Systems, devices, media, and methods are presented for identifying emerging viewing patterns for visual media such as still images and videos. Emerging viewing patterns are identified by identifying visual tags for visual media viewed by users, selecting a subset of the tags by applying a taxonomy-based filter, generating pattern candidates from the subset, evaluating consumption metrics for each of the generated patterns, and ranking the generated pattern candidates responsive to the consumption metrics to identify emerging viewing patterns for the users.