Methods and systems that facilitate efficient and effective adaptive execution mode selection are described. The adaptive execution mode selection is performed in part on-the-fly and changes to an execution mode (e.g., sequential, parallel, etc.) for a program task can be made. An intelligent adaptive selection can be made between a variety execution modes. The adaptive execution mode selection can also include selecting parameters associated with the execution modes. A controller receives historical information associated with execution mode selection, engages in training regarding execution mode selection, and adaptively selects an execution mode on-the-fly. The training can use an approach similar to an artificial neural network in which automated guided machine learning approach establishes correspondences between execution modes and task/input feature definitions based upon historical information. An adaptive selection is performed on-the-fly based on an initial trial run.