A device intelligence architecture configures and controls on-site devices and performs environment monitoring to facilitate effective device functionality. The architecture facilitates efficient use of devices (e.g., robotics) in an unstructured and dynamic environment, which will allow deployments in many more environments than is currently possible. The architecture stores and shares information between segregated devices to avoid the silo effect of vendor specific stacks. The architecture also models capabilities of devices and maps actions to intelligence packages to deploy a specific intelligence package to the device. The architecture also implements distributed processing. For instance, computationally intensive tasks may be offloaded to the back end processing, with action updates resulting from the processing pushed to the devices.