An online system maintains various labels identifying physical locations, allowing users to identify a physical location to the online system by specifying the label identifying the physical location. When a user does not identify a label corresponding to location coordinates provided to the online system by a client device, the online system selects a maintained label and prompts the user to indicate whether the user visited the physical location identified by the selected label. To select the label, the online system accounts for likelihoods of the received location coordinates being identified by various labels and values of the online system of identifying whether different labels identify received location coordinates. The online system may also account for other prompts presented to the user or to other users when determining whether to prompt the user to indicate whether the user visited the physical location identified by the selected label.