A recorded experience in a virtual worlds system may be played back by one or more servers instantiating a new instance of a scene using one or more processors of the one or more servers and playing back the recorded experience in the new instance by modeling objects of a recorded initial scene state of the recorded experience in the new instance and updating the recorded initial scene state based on subsequent recorded changes over a time period, a recorded experience file includes the recorded initial scene state and the subsequent recorded changes and is stored in one or more memories of the one or more servers. One or more client devices are in communication with the one or more servers to participate in the new instance.