A system and related method are provided for sensor-based person recognition. The system has a data store including global data of a user, the global data including a globally unique identifier and sensed training data. The system further has a classifier to identify the user at a first time using the global data, augment the global data with first context information of the user captured at the first time, and identify the user at a second time by finding correlations between second context information and the first context information when using the global data fails, the second context information of the user captured at the second time.