Systems and methods for operating a vehicle automatically in real time may be provided. The system may receive and process real time sensor data from a sensing system via an arithmetic and control unit (ACU). The system may obtain, via the ACU, one or more tasks during the processing of the real time sensor data. The system may classify, via the ACU, the one or more tasks into real time vehicle controlling (VC) tasks and non real time VC tasks. The system may further send the real time VC tasks to at least one dedicated processing core of the ACU for processing the real time VC tasks and generating one or more real time VC commands accordingly.