A rearview mirror assembly for a vehicle includes a mirror head pivotally mounted at a mounting base configured for attachment at a side of a vehicle. The mirror head includes a mirror casing and a reflective element adjustably disposed at the mirror casing. A powerfold actuator is operable to pivot the mirror head relative to the mounting base between at least a park detent position and a drive detent position. The mirror head is manually pivotable to a non-detent position other than the park detent position and the drive detent position. Responsive to the mirror head being at a non-detent position and responsive to a single actuation of a user input, the powerfold actuator is operable to pivot the mirror head to either the park detent position or the drive detent position.