A vision system of a vehicle includes a camera, a display unit and a controller. The camera is disposed at a vehicle and has a field of view exterior of the vehicle. The camera is operable to capture image data. The display unit includes a display screen disposed at a display area at a windshield of the vehicle. The display unit is electrically changeable from a non-display state to a display state. When the vehicle is being driven, the controller, responsive to a determination that the gaze of the driver of the vehicle is at the display area for a threshold period of time, changes the display unit from its non-display state to its display state. When in its display state, the display unit displays images at said display screen that are derived from captured image data.