Computer-assisted surgical systems and methods provide intraoperative playback of and interaction with recorded video images and/or a 3D model while displaying current video images. The methods and related surgical systems involve capturing, by a two-dimensional (2D) or three-dimensional (3D) video camera, current video images and recording the captured video images. A user interface displays the current video images and the recorded video images and/or the 3D model and enables a user to interact with either or both of them.