The present invention is directed toward a device and system having a sensor hub capable of receiving measurement outputs from a plurality of sensors and processing the measurements for output to other devices, such as by using a single chip arrangement. The sensor hub provides for facilitating efficient communication among the sensors for improved high-level features, such as interpreting gestures or actions according to the context. Two or more hierarchical processing levels may be provided so that sensor data processed at a lower level is output to an upper level for further processing or other operation involving the processed data from the lower level.