Methods and systems for assessing the quality of an item listing are described. In an example embodiment, a listing quality score for an item listing is derived as a weighted sum of first and second parts. The first part represents a predicted score based on a comparison of item attributes for the item listing that are known at listing time, with item attributes of similar item listings that have historical data available for assessing their actual performance. The second part is based on one or more observed demand metrics representing actual historical performance of the item listing. The weighting factor is derived, such that over time, the emphasis shifts from the predicted to the observed score.