A device, system and method for controlling autonomous vehicles using a visual notification device. A movement detector is used to detect a user gesture of a user. A controller in communication with the movement detector is used to control a visual notification device to provide a visual indication of the user gesture combined with authentication data stored at a memory, to visually instruct the autonomous vehicle to perform an action associated with the user gesture upon verification of the authentication data.