Disclosed is a system, apparatus, computer readable storage medium, and method to perform a context inference for a mobile device. In one embodiment, a data processing system includes a processor and a storage device configurable to store instructions to perform a context inference for the data processing system. Data may be received from at least a first sensor, and a first classification of the data from the sensor may be performed. Confidence for the first classification can be determined and a second sensor can be activated based on a determination that the confidence fails to meet a confidence threshold. A data sample classification from the activated second sensor may be classified jointly with the data from first sensor.