System and techniques for tracking caloric expenditure using sensor driven fingerprints are described herein. A set of outputs may be obtained from a plurality of sensors. A fingerprint may be generated using the set of outputs. The fingerprint may correspond to an activity observed by the plurality of sensors. The generated fingerprint may be compared to a set of fingerprints stored in a database. Each fingerprint of the set of fingerprints may correspond to a respective caloric expenditure. A caloric expenditure may be calculated for the activity based on the comparison. An exercise profile of a user may be updated using the caloric expenditure