A vehicular interior rearview mirror assembly includes a mirror head that is pivotally attached via a pivot joint at a mounting structure and that accommodates a reflective element. A display device is disposed within the mirror head. An actuator is disposed within the mirror head and includes an actuator base attached at a rear portion of the reflective element, an actuator body that is pivotally attached at the actuator base, and an electrically operable motor. When the motor is electrically operated, the actuator body pivots relative to the actuator base to pivot the mirror head relative to a socket element of the pivot joint. Pivotal movement of the mirror head relative to the socket element adjusts the reflective element between a mirror mode orientation and a display mode orientation. When the reflective element is in the display mode orientation, the display device is actuated to display video images.