Embodiments disclosed herein provide methods, systems, and computer readable storage media for facilitating controlling a meeting between remote Augmented Reality (AR) and Virtual Reality (VR) participants. In a particular embodiment, a method provides, during a conference session wherein a plurality of head mounted displays (HMDs) are each worn by one of a plurality of participants, compiling first orientation information and first view information from a first HMD of the plurality of HMDs. The orientation information describes current orientation of the first HMD. Based on the first orientation information and the first view information, the method provides determining a first change to how video is presented the first HMD. Also, the method provides directing the first HMD to implement the first change.