An image-based recommendation system provides a first set of selectable images to a user and receives user selections from the first set of images. If a user selects a single image from the first set of images, the product page associated with the selected image is transmitted to the user. If the user makes multiple selections from the first set of images, then the images associated with the user selections are analyzed and a second set of similar images is generated for transmission to the user. The process of receiving and analyzing user-selected images, generating image sets and transmission of generated images sets continues until the user selects a single image. The precision of identification of similar images can be improved by providing the user selections as training data to the image-based recommendation system.