A system for conveying and reproducing images for use with interactive applications is described. The system includes one or more application modules producing images for a display, and a display server for deriving encoded representations of the images and forwarding them to one or more clients. The client includes one or more user input devices such as a touchpad or touchscreen, and forwards information derived from the data received from these devices to the display server. The information is also used locally to modify reconstructed images derived from the encoded image representations received from the display server. The modified reconstructed images are displayed on a video screen.