Described are techniques for shared viewing of video among remote users, including methods and corresponding systems and apparatuses. A first computer device operated by a first user can receive an input video stream representing a three-dimensional (3D) space. From the input video stream, an output video stream corresponding to the 3D space as seen from a viewing direction specified by the first user is generated. The output video stream includes images that cover a narrower field of view compared to the input video stream. The first computer device can receive information indicating a viewing direction specified by a second user, who is a user of a second computer device. The first computer device can update the output video stream based on the information indicating the viewing direction specified by the second user. The updated output video stream can then be presented on a display of the first user.