Visual images may be used to detect, or verify the existence of, landmarks. In one example, the landmarks may be used to provide driving or walking directions. A set of records may be examined to identify the street addresses of businesses or other entities. Additionally, street-level images may be captured with a camera, and the locations at which the images were captured may be recorded. The images may be evaluated with an Optical Character Recognition (OCR) process to determine what words appear in the images. The words in the image are compared with the names of entities whose addresses are near where the image was captured. If the words match the entity name, then a sign identifying the entity is presumed to be visible along a particular route, and the entity may be used as a landmark in a set of walking or driving directions.