A vehicular camera monitoring system includes a rearward-viewing camera, a driver-side camera, a passenger-side camera and a dual-mode interior rearview mirror assembly disposed at an interior cabin of a vehicle. The dual-mode interior rearview mirror assembly is operable in a mirror mode and a display mode. With the vehicle traveling along a road, and with the dual-mode interior rearview mirror assembly operating in the display mode, a video display screen displays video images derived at least in part from image data captured by the rearward-viewing camera, the driver-side camera and/or the passenger-side camera. The video display screen displays at least passenger-side video images of a passenger-side region sideward and rearward of the passenger side of the vehicle until a period of time elapses following a passenger exiting the vehicle from a passenger seat of the vehicle.