A database for object recognition is modified based on feedback information received from a mobile platform. The feedback information includes information with respect to an image of an object captured by the mobile platform. The feedback information, for example, may include the image, features extracted from the image, a confidence level for the features, posterior probabilities of the features belonging to an object in the database, GPS information, and heading orientation information. The feedback information may be used to improve the database pruning, add content to the database or update the database compression efficiency. The information feedback to the server by the mobile platform may be determined based on a search of a portion of the database performed by the mobile platform using features extracted from a captured query image.