Social interactions between two or more users in a mixed reality environment are described. Techniques describe receiving data from a sensor. Based at least in part on receiving the data, the techniques describe determining that an object associated with a first user that is physically present in a real scene interacts with a second user that is present in the real scene. Based at least in part ondetermining that the object interacts with the second user, causing virtual content corresponding to the interaction and at least one of the first user or the second user to be presented on a user interface corresponding to a mixed reality device associated with the first user. The user interface can present a view of the real scene as viewed by the first user that is enhanced with the virtual content.