A vehicular interior rearview mirror assembly includes a mirror head and a display device disposed in the mirror head and behind a reflective element. An actuator is operable to adjust the mirror head between a mirror mode orientation and a display mode orientation. Operation of the actuator moves a cam follower to cause a pin at the mirror head to travel along the groove to adjust orientation of the mirror head. With the mirror head in the mirror mode orientation, a first voltage is applied to adjust the mirror head out of the mirror mode orientation. A second voltage that is lower than the first voltage is then applied to adjust the mirror head toward the display mode orientation. A third voltage that is higher than the second voltage is then applied to adjust the mirror head into the display mode orientation.