A method and device for rendering a scene comprising one or more real objects. A virtual object is associated with each real object, a virtual object associated with a real object corresponding to a virtual replica of this real object. The virtual replica is used to render a transformation that may be applied to the real object when for example hit by a virtual object, the virtual object then replacing the corresponding real object within the scene. To bring realism to the scene, texture information obtained from image(s) of the real object(s) is used to texture the visible part(s) of the transformed virtual object(s). The texture information is selected in the images by using information on the visibility of the parts of the real object(s) that correspond to the visible parts of the transformed virtual object(s).