Methods and systems of providing metadata association with videos on a video hosting system on a computer network are provided. Search records associated with search queries directed to the video hosting system are received. Each search record identifies videos that are search results for a search query and indicates view durations that the videos were viewed responsive to the search query. First and second videos competing for views of users are identified from the received search records. The first and second videos each have metadata respectively describing the first and second videos. Search queries directed to the first video are identified from the search records. Search terms associated with the search queries are further identified and compared to the metadata of the second video. Search terms that are not included in the metadata of the second video are identified as metadata improvements to the second video.