A method and arrangement are disclosed for allowing secondary tasks during semi-automated driving of a road vehicle having an infotainment system including one or more display units, and a semi-automated driver assist system having one or more sensors for acquiring data of a road ahead. A confidence of the ability of the semi-automated driver assist system to control the road vehicle autonomously is determined from at least acquired data of the road ahead. A viewing direction of a driver of the road vehicle is determined by using a driver monitoring camera. Autonomous control is allowed if the viewing direction of the driver is determined to be towards the road ahead or towards a display unit of the infotainment system and the confidence is determined to be above a confidence threshold, otherwise any ongoing autonomous control is cancelled and the driver urged to assume control of the road vehicle.