A method and system may manage the driver's attention while driving. The driver may be driving using an autonomous driving system or limited-ability autonomous driving system. A method may detect, by a sensor, characteristics of a driver; determine, based on the detected characteristics of the driver, whether the driver exercises sufficient supervisory control of the vehicle; and provide a series of one or more prompts, wherein each prompt's intrusiveness is related to the determination of whether the driver exercises sufficient supervisory control of the vehicle.