A payment processing system receives one or more indications of a user's location at a time that the user initiates a transaction with a merchant system at a physical location of the merchant system, processes the transaction, and receives a merchant point of sale identifier from the issuer system associated with the financial account information selected by the user. The payment processing system creates a combined list of candidate merchant identities based on the received merchant POS identifier and the user computing device location. The payment processing system calculates a probability for each of the merchant identities in the list based on similarity to the merchant POS identifier and user location data. The payment processing system associates the merchant POS identifier with the merchant identity having the highest probability and creates an annotated transaction record to display to the user.