Methods and systems for remote rendering of extended reality (XR) objects are described herein. A server may receive an image of a physical environment. The image may include different views of the physical environment around a client device. The server may render at least one surface of a virtual object based on the different views of the physical environment. The at least one surface may include a reflection of another object of the physical environment from a view point of the client device at the time the image was taken. The server may generate graphics including the rendered at least one surface. The server may send the generated graphics to the client device to enable display of a computer generated environment on the client device. The computer generated environment may include the at least one virtual object with an appearance of a reflective surface.