A technique for remote mixed-reality interaction between users includes determining a first position of a first object within a first three-dimensional (3D) space; generating first information associated with the first 3D space for the first object based on the first position; transmitting the first information to a computing device that renders first video content for display within a second 3D space based on the first information; and while transmitting the first information to the computing device, receiving second information that is associated with the second 3D space and with a second object and generated based on a second position determined for the second object within the second 3D space.