Systems and methods are disclosed for determining the location where an image was captured. In general, a device such as a smartphone may capture one or more images from a location, such as images of buildings, street signs and the like, and a central system may compare the submitted images to images in an image library to identify matches. The location of the match may then be provided back to the smartphone.