Computer-implemented methods, computer-readable storage media storing instructions and computer systems for labeling significant locations based on contextual data can be implemented to perform operations that include determining a location of a computing device, and determining a label for the determined location based on contextual data associated with the significant location. The location can be a significant location that has meaning to a user of the device.