Advertisements to be presented to a user are selected based on feedback responses received from other users where the feedback responses represent the level of interest to the advertisements expressed by the other users. In selecting which advertisements to be presented to a user, the online service takes into account feedback responses previously collected from a group of users and revenue expected for presenting certain advertisements to the user. An online service computing device computes a total value of an advertisement based on an estimated revenue value for presenting an advertisement and a modifier representing the user's estimated interest in the advertisements. The modifier is normalized based on a market value of the corresponding advertisement or a user. The online service then selects or prioritizes the advertisements based on the total values.