A building management system with artificial intelligence based control of a building includes data collectors are configured to receive data and generate data streams for subsystems of the building. The system includes a learning engine configured to identify a building state of the building by correlating data of the data streams for the subsystems and provide the identified building state to cognitive agents. The system includes the cognitive agents, each of the cognitive agents configured to receive the identified building state from the learning engine, generate a control decision based on the received building state, and operate at least one of the plurality of subsystems of the building to control a physical condition of the building based on the control decision.